-- Logs begin at Thu 2022-07-21 03:37:40 UTC, end at Thu 2022-07-21 04:43:17 UTC. -- Jul 21 04:03:41.390360 dv-cinder-822822-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 21 04:03:41.401337 dv-cinder-822822-6-smb devstack@keystone.service[80595]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 21 04:03:41 2022] *** Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: nodename: dv-cinder-822822-6-smb Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: machine: x86_64 Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: clock source: unix Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: pcre jit disabled Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: detected number of CPU cores: 4 Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: current working directory: / Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: detected binary path: /usr/bin/uwsgi-core Jul 21 04:03:41.404035 dv-cinder-822822-6-smb devstack@keystone.service[80595]: your processes number limit is 47680 Jul 21 04:03:41.404746 dv-cinder-822822-6-smb devstack@keystone.service[80595]: your memory page size is 4096 bytes Jul 21 04:03:41.404746 dv-cinder-822822-6-smb devstack@keystone.service[80595]: detected max file descriptor number: 2048 Jul 21 04:03:41.404746 dv-cinder-822822-6-smb devstack@keystone.service[80595]: lock engine: pthread robust mutexes Jul 21 04:03:41.404746 dv-cinder-822822-6-smb devstack@keystone.service[80595]: thunder lock: enabled Jul 21 04:03:41.404746 dv-cinder-822822-6-smb devstack@keystone.service[80595]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 21 04:03:41.404746 dv-cinder-822822-6-smb devstack@keystone.service[80595]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 21 04:03:41.447666 dv-cinder-822822-6-smb devstack@keystone.service[80595]: Python main interpreter initialized at 0x557d46f3c9c0 Jul 21 04:03:41.447666 dv-cinder-822822-6-smb devstack@keystone.service[80595]: python threads support enabled Jul 21 04:03:41.447666 dv-cinder-822822-6-smb devstack@keystone.service[80595]: your server socket listen backlog is limited to 100 connections Jul 21 04:03:41.447666 dv-cinder-822822-6-smb devstack@keystone.service[80595]: your mercy for graceful operations on workers is 90 seconds Jul 21 04:03:41.447962 dv-cinder-822822-6-smb devstack@keystone.service[80595]: mapped 403077 bytes (393 KB) for 2 cores Jul 21 04:03:41.448039 dv-cinder-822822-6-smb devstack@keystone.service[80595]: *** Operational MODE: preforking *** Jul 21 04:03:41.448284 dv-cinder-822822-6-smb devstack@keystone.service[80595]: *** uWSGI is running in multiple interpreter mode *** Jul 21 04:03:41.448284 dv-cinder-822822-6-smb devstack@keystone.service[80595]: spawned uWSGI master process (pid: 80595) Jul 21 04:03:41.448463 dv-cinder-822822-6-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 21 04:03:41.449507 dv-cinder-822822-6-smb devstack@keystone.service[80595]: spawned uWSGI worker 1 (pid: 80605, cores: 1) Jul 21 04:03:41.449507 dv-cinder-822822-6-smb devstack@keystone.service[80595]: spawned uWSGI worker 2 (pid: 80606, cores: 1) Jul 21 04:03:41.449507 dv-cinder-822822-6-smb devstack@keystone.service[80595]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 21 04:03:46.900104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 04:03:46.900104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: from cryptography.utils import int_from_bytes Jul 21 04:03:46.900936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 04:03:46.900936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: from cryptography.utils import int_from_bytes Jul 21 04:03:46.901359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 04:03:46.901359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: from cryptography.utils import int_from_bytes Jul 21 04:03:46.901470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 21 04:03:46.901470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: from cryptography.utils import int_from_bytes Jul 21 04:03:46.949060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 04:03:46.949238 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 21 04:03:46.949392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 04:03:46.949486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] command line args: [] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 04:03:46.949564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 21 04:03:46.949669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] command line args: [] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 21 04:03:46.949756 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 04:03:46.949860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ================================================================================ {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 04:03:46.949945 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 21 04:03:46.950110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] admin_token = **** {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.950195 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ================================================================================ {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 21 04:03:46.950354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] config_dir = [] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.950444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] admin_token = **** {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.950546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.950655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] config_dir = [] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.950739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] config_source = [] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.950870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.950974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] debug = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.951096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] config_source = [] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.951181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.952364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] debug = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.952437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.952510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.952598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.952659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.952721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.952721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.952841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.952900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] list_limit = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.952963 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] log_config_append = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953127 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] log_dir = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] list_limit = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] log_file = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] log_config_append = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953427 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] log_dir = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] log_file = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953781 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.953843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.954014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.954097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.954159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.954222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.954389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.954494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.955265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.955451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.955574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.955675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.955770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.955893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.956014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.956133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.956253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.956372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.956487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.956608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.956730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.956850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.956850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.957083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.957214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.957339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.957458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.957580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] publish_errors = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.957692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.957816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.958023 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.958412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.48/identity {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.958530 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.958656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] publish_errors = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.958776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.958889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.959022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.959147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.959280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.959403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] standard_threads = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.959518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.959631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.959750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.959864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.960028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] standard_threads = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.960144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.960257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.960369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] use_journal = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.960369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] use_json = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.960579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.960579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.960801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] use_stderr = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.960915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] use_journal = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.961033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] use_syslog = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.961147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] use_json = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.961261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.961374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] use_stderr = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.961374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] use_syslog = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.961585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.961703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 21 04:03:46.961819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.961939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.962059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.962174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.962292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.962410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.962524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.962649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.962769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.962884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.963010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.963134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.963249 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.963370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.963484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.963603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.963723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.963844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.963957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.964078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.964192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.964310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.964429 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.964544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.964669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.964795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.964915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.965029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.965029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.965240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.965356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.965548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.965664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.965778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.965890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.966004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.966124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.966246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.966361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.966474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.966586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.966699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.966817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.966940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.967090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.967212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.967327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.967446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.967560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.967685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.967799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.967912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.968026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.968138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.968251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.968375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.968489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.968608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.968722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.968834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.968958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.969074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.969186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.969304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.969423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.969423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.969650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.969793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.969907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.970002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.970063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.970121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.970188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.970247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.970370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.970491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.970606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.970725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.970915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.971045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.971170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.971285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.971399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.971517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.971643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.971757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.971870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.971983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.972097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.972210 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.972332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.972446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.972559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.972678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.972798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.972912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.973033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.973147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.973262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.973375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.973494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.973608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.973729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.973843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.973956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.974079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.974178 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.974307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.974417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.974517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.974612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.974714 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.974810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.974906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.975080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.975183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.975267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.975388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.975508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.975624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.975745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.975868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.975983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.976099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.976221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.976221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.976453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.976567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.976688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.976804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.976923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.977034 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.977147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.977261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.977372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.977494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.977608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.977729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.977843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.977970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.978165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.978301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.978418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.978533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.978637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.978757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.978873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.979001 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.979116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.979241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.979357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.979480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.979596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.979716 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.979832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.979946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.980065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.980189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.980304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.980425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.980546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.980662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.980776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.980898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.981014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.981127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.981241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.981355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.981468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.981591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.981699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.981819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.981964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.982081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.982194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.982388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.982505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.982619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.982743 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.982858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.982985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.983113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.983239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.983367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.983483 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.983598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.983712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.983827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.983941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.984063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.984179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.984293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.984406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.984520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.984633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.984756 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.984872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.984994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.985109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.985223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.985902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.986051 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.986168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.986267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.986363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.986458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.986578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.986703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] auth.external = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.986820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] auth.external = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.986935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.987094 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.987209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.987209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.987468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.987595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] auth.password = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.987730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.987848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] auth.token = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.987964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] auth.password = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.988079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.988194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] auth.token = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.988319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.988436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.988551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.988671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.988787 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.988911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.989039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.989162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.989278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.989393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.989507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.989628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.989752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] credential.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.989868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.989983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.990099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] credential.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.990204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.990317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.990439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.990561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.990677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.990791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.990906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.991037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.991166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.991283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.991398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.991513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.991627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.991741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.991864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.991980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.992095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.992211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.992326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.992441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.992563 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.992690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.992813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.992935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.993051 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.993171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.993295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.993412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.993542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] federation.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.993660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.993775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.993889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] federation.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.994012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.994128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.994244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.994359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.994479 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.994595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.994719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.994836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.994975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.995093 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.995207 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.995323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.995450 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.995568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.995684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.995803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.995918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.996042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.996166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.996283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.996399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.996514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.996629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.996743 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.996936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.997054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.997169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.997290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.997408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.997531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.997648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.997763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.997878 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.997992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.998106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.998228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.998351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.998468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.998584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.998699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.998814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.998814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.999064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.999179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.999293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.999408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.999524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.999650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.999768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.999768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:46.999984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.000099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.000214 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.000337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.000454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.000571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.000695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.000811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.000926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.000926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.001823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.002011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.002208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.002341 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.002458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.002587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.002706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.002823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.002938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.003071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.003186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.003314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.003432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.003548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.003664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.003780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.003895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.004019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.004143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.004260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.004375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.004490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.004612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.004739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.004855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.004971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.005086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.005201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.005315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.005438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.005555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.005670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.005786 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.005905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.006020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.006143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.006260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.006376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.006491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.006607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.006730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.006855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.007031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.007151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.007266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.007380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.007495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.007622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.007739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.007855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.007969 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.008085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.008199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.008357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.008475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.008589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.008704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.008819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.008935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.009058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.009175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.009290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.009404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.009519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.009633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.009756 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.009873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.009989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.010103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.010218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.010340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.010457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.010572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.010687 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.010801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.010915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.011060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.011179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.011294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.011408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.011522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.011636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.011993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.012114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.012229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.012344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.012458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.012573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.012695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.012812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.012927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.013042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.013158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.013273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.013395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.013512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.013627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.013741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.013855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.013970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.013970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.014196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.014196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.014411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.014526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.014764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.014881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.015054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.015174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.015290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.015406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.015529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.015645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.015761 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.015879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.015994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.016109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.016232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.016350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.016464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.016610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.016763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.016900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.017010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.017111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.017208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.017324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.017439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.017555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.017678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.017795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.017795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.018026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.018177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] resource.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.018294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.018294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.018522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.018636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.018751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.018865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] resource.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.018992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.018992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.019227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.019343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.019343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.019569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.019684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.019684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.019910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.020026 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.020141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.020255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] role.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.020370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.020557 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] role.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.020675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.020790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.020905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.021020 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.021134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.021262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.021380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.021496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.021611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] role.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.021732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.021848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] role.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.021971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.022088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.022203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.022318 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.022433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.022548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.022672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.022789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.022904 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.023117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.023234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.023361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.023480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.023597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.023713 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.023827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.023942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.024065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.024182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.024297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.024412 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.024527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.024643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.024781 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.024931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.025048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.025164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.025278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.025393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.025516 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.025634 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.025750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.025868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.025982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.026097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.026221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.026338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.026451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.026566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.026680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.026796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.026919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.027052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.027168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.027283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.027397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.027512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.027639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.027756 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.027954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.028072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.028187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.028311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.028428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.028543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.028658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.028773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] token.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.028888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.029011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.029127 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.029242 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.029242 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.029457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.029457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.029680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.029797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.029912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.030027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] token.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.030142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.030257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.030380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.030497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.030613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.030728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.030872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.030872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.031144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.031263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.031378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.031494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.031609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.031790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.031917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.032035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.032150 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.032292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.032408 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.032506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.032612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.032612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.032811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.032926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.033041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.connection = **** {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.033164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.033289 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.033405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.033528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.033645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.033759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.033873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.033994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.033994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.034220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.034336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.034451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.connection = **** {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.034575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.034699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.034816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.034930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.035070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.035189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.035304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.035419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.035540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.035656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.035778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.035899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.036015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.036129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.036245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.036360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.036482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.036599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.036714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.036828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.036942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.037056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.037179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.037297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.037412 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80606) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 04:03:47.037527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.037527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.037527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.037527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.037527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.037527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 21 04:03:47.037527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80605) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 21 04:03:47.065967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.066190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.066423 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.066508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.066727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.066971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.074675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.075287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.102975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.103218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.103304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.103525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.247041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.248149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.297305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.297540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.299578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.299822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.362432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.362654 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.362879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.363126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.363304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.363392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.363541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.363625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.363769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.363990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.364209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.364426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.388571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.388809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.389033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.389120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.389256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.389340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.389474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.389566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.389692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.389775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.389909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.389990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.390129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.390346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.401530 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.401661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.414293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.414528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.414754 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.414999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.415085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.415221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.415303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.415437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.415520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.415653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80606) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.415734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.415892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.416105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.416319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80605) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 21 04:03:47.432911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.433122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 04:03:47.433214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.433341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 04:03:47.433528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.433682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.433767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 04:03:47.433882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 21 04:03:47.433988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.434152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.434285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.434414 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.434497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.434673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.434755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.434929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.446476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.446755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.447047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.447304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.447393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.447587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.447854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.448138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.456266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.457339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.459853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.460129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.460407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.460800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.460922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.461083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.461200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.461343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.461478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.461613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.461868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.461952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.462140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.462221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.462397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.462476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.462664 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.462745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.462932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.463225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.463493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.463760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.489527 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.490176 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.491156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.491434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.491813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.492089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.496723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.497004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.497288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.497367 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.497566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.497841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.505101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.505379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.505850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.506129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.510001 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.510287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.510568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.510717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.510853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.511019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.511158 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.511298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.511429 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.511577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.511695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.511850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.511959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.512121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.512387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.512647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.531085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.531358 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.531715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.531987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.536066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.536595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.539731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.540025 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.540209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.540499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.545046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.545475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.548809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.549160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.552593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.552888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.552970 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.553176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.553259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.553459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.553548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.553742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.553825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.554014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.554094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.554288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.573581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.573774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.573953 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.574142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.574239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.574409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.574490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.574669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.583124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.583563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.585099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.585215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.585374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.585456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.588459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.588602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.588739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.588829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.589015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.589097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.589289 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.589381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.589615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.589700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.602994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.603258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.603344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.603534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.603615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.603808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.603898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.604082 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.604165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.604357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.604438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.604633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.604714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.604914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.623934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.624358 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.627760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.628192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.631050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.631516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.632649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.633122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.634267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.634546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.634750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.634836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.635052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.635340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.642906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.643574 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.644554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.645216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.647787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.648075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.648355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.648486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.648628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.648773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.649052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.649324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.657854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.658133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.658408 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.658711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.659088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.659369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.666215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80605) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.666491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.666766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.667064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.667242 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80606) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 21 04:03:47.667325 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.667520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.667603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.667799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.667883 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.668072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.668154 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.668349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.668435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.668633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.668717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.668906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.669037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.669178 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.669259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.669444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.669525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.669703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80605) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.669783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.669974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.670231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.670501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.670764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80606) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 21 04:03:47.708998 dv-cinder-822822-6-smb devstack@keystone.service[80605]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557d46f3c9c0 pid: 80605 (default app) Jul 21 04:03:47.710239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557d46f3c9c0 pid: 80606 (default app) Jul 21 04:03:47.712282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9d01-c25e-42dd-a66e-5e1c90af0934 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:03:47.712577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9d01-c25e-42dd-a66e-5e1c90af0934 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:03:47.712857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d9d01-c25e-42dd-a66e-5e1c90af0934 None None] PATH_INFO: `/v3` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:03:47.717024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 791 bytes} [Thu Jul 21 04:03:47 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:03:55.274309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3d10f-740a-4c44-a302-635eff746fff None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:03:55.274847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3d10f-740a-4c44-a302-635eff746fff None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:03:55.274847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae3d10f-740a-4c44-a302-635eff746fff None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:03:55.279194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1/2] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:03:55 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:03:55.285175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:03:55.285556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:03:55.285741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:03:55.355546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: INFO dbcounter [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] Registered counter for database keystone Jul 21 04:03:55.376742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG oslo_db.sqlalchemy.engines [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80605) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 04:03:55.383067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writer thread running {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 04:03:55.556818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG passlib.handlers.bcrypt [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80605) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 04:03:55.557157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG passlib.handlers.bcrypt [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80605) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 04:03:55.611420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:03:55.613069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:03:55.732471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 2/3] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:03:55 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 04:03:55.916835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3d10f-740a-4c44-a302-635eff746fff None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:03:55.987692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: INFO dbcounter [None req-fae3d10f-740a-4c44-a302-635eff746fff None None] Registered counter for database keystone Jul 21 04:03:56.007026 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG oslo_db.sqlalchemy.engines [None req-fae3d10f-740a-4c44-a302-635eff746fff None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80606) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 21 04:03:56.013149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writer thread running {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 21 04:03:56.133844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae3d10f-740a-4c44-a302-635eff746fff None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:03:56.138113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246100f8-13aa-44ad-a9f0-fc031fe44882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:03:56.138781 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246100f8-13aa-44ad-a9f0-fc031fe44882 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:03:56.139096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246100f8-13aa-44ad-a9f0-fc031fe44882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:03:56.139378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246100f8-13aa-44ad-a9f0-fc031fe44882 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:03:56.147799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246100f8-13aa-44ad-a9f0-fc031fe44882 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:03:56.199796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WARNING keystone.common.rbac_enforcer.enforcer [None req-246100f8-13aa-44ad-a9f0-fc031fe44882 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 04:03:56.200145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246100f8-13aa-44ad-a9f0-fc031fe44882 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:03:56.210693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 2/4] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jul 21 04:03:55 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:03:56.216754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:03:56.231591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba59cd-1fbd-4156-ad6d-0c15411bcc38 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:03:56.235998 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e01f0f-ff34-4ec2-a651-9666cb76fafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:03:56.238201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e01f0f-ff34-4ec2-a651-9666cb76fafe admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:03:56.238488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e01f0f-ff34-4ec2-a651-9666cb76fafe admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:03:56.238770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e01f0f-ff34-4ec2-a651-9666cb76fafe admin admin] PATH_INFO: `/v3/projects/39bed1c15cc5411994e7f051730f1155` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:03:56.242894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e01f0f-ff34-4ec2-a651-9666cb76fafe admin admin] RBAC: Authorizing `identity:get_project(project_id=39bed1c15cc5411994e7f051730f1155)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:03:56.294309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d8e01f0f-ff34-4ec2-a651-9666cb76fafe admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 21 04:03:56.294852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e01f0f-ff34-4ec2-a651-9666cb76fafe admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:03:56.300228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 3/5] 10.222.0.48 () {56 vars in 1207 bytes} [Thu Jul 21 04:03:56 2022] GET /identity/v3/projects/39bed1c15cc5411994e7f051730f1155 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:03:58.318982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465263-19be-4518-a4fb-0dd9375077e2 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:03:58.319502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465263-19be-4518-a4fb-0dd9375077e2 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:03:58.319598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69465263-19be-4518-a4fb-0dd9375077e2 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:03:58.323675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 3/6] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:03:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:03:58.329159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cf0d7-f1c9-41c1-b5e7-5a4a8b58af56 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:03:58.329534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cf0d7-f1c9-41c1-b5e7-5a4a8b58af56 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:03:58.329709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36cf0d7-f1c9-41c1-b5e7-5a4a8b58af56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:03:58.348421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b36cf0d7-f1c9-41c1-b5e7-5a4a8b58af56 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:03:58.349942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b36cf0d7-f1c9-41c1-b5e7-5a4a8b58af56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:03:58.357622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 4/7] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:03:58 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 21 04:03:58.380336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465263-19be-4518-a4fb-0dd9375077e2 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:03:58.392205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69465263-19be-4518-a4fb-0dd9375077e2 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:03:58.396861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a202129-2311-498b-ab27-60e9d502c4c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:03:58.397488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202129-2311-498b-ab27-60e9d502c4c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:03:58.397774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202129-2311-498b-ab27-60e9d502c4c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:03:58.398052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a202129-2311-498b-ab27-60e9d502c4c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:03:58.405724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a202129-2311-498b-ab27-60e9d502c4c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:03:58.407551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a202129-2311-498b-ab27-60e9d502c4c5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:03:58.416308 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 4/8] 10.222.0.48 () {58 vars in 1324 bytes} [Thu Jul 21 04:03:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 04:03:58.421751 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cf0d7-f1c9-41c1-b5e7-5a4a8b58af56 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:03:58.431619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36cf0d7-f1c9-41c1-b5e7-5a4a8b58af56 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:03:58.436080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c87b9-f044-418e-a019-3481679d79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:03:58.436895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c87b9-f044-418e-a019-3481679d79c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:03:58.437186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c87b9-f044-418e-a019-3481679d79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:03:58.437467 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c87b9-f044-418e-a019-3481679d79c0 admin admin] PATH_INFO: `/v3/users/9b72d80a668e4df2ad631da1eeae4189` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:03:58.438867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c87b9-f044-418e-a019-3481679d79c0 admin admin] RBAC: Authorizing `identity:get_user(user_id=9b72d80a668e4df2ad631da1eeae4189)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:03:58.441335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c87b9-f044-418e-a019-3481679d79c0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:03:58.442914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 5/9] 10.222.0.48 () {56 vars in 1198 bytes} [Thu Jul 21 04:03:58 2022] GET /identity/v3/users/9b72d80a668e4df2ad631da1eeae4189 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:00.525461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d3ec-b732-42c3-9678-56a4ec63cde6 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:00.525957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d3ec-b732-42c3-9678-56a4ec63cde6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:00.526046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95d3ec-b732-42c3-9678-56a4ec63cde6 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:00.527454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 5/10] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:00.531521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb783e-6900-42a8-a915-c40efb1ea601 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:00.531908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb783e-6900-42a8-a915-c40efb1ea601 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:00.532075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abb783e-6900-42a8-a915-c40efb1ea601 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:00.532399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8a49d-d3df-47dd-b3b2-336201f3d61e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:00.532687 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8a49d-d3df-47dd-b3b2-336201f3d61e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:00.532962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8a49d-d3df-47dd-b3b2-336201f3d61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:00.533423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 6/11] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:00.538499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72177f21-6c28-455c-a406-6c7b54290f4b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:00.538795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72177f21-6c28-455c-a406-6c7b54290f4b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:00.539311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72177f21-6c28-455c-a406-6c7b54290f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:00.555909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-72177f21-6c28-455c-a406-6c7b54290f4b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:00.557103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-72177f21-6c28-455c-a406-6c7b54290f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:00.573242 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG passlib.handlers.bcrypt [None req-99f8a49d-d3df-47dd-b3b2-336201f3d61e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80606) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 21 04:04:00.573650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG passlib.handlers.bcrypt [None req-99f8a49d-d3df-47dd-b3b2-336201f3d61e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80606) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 21 04:04:00.619529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-99f8a49d-d3df-47dd-b3b2-336201f3d61e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:00.621098 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-99f8a49d-d3df-47dd-b3b2-336201f3d61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:00.637511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 7/12] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:00.659710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72177f21-6c28-455c-a406-6c7b54290f4b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:00.683197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:00.721368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 6/13] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:00.745892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8a49d-d3df-47dd-b3b2-336201f3d61e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:00.763332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72177f21-6c28-455c-a406-6c7b54290f4b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:00.797582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670a10f-1416-4672-8c3a-2c034777e368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:00.798172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670a10f-1416-4672-8c3a-2c034777e368 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:00.798455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670a10f-1416-4672-8c3a-2c034777e368 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:00.798732 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670a10f-1416-4672-8c3a-2c034777e368 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:00.844446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f8a49d-d3df-47dd-b3b2-336201f3d61e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:00.847290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:00.868555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670a10f-1416-4672-8c3a-2c034777e368 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:00.870057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4670a10f-1416-4672-8c3a-2c034777e368 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:00.883835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4dcd7-ed74-43b0-afcb-e5cbe353ea23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:00.884888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4dcd7-ed74-43b0-afcb-e5cbe353ea23 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:00.885179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4dcd7-ed74-43b0-afcb-e5cbe353ea23 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:00.885461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb4dcd7-ed74-43b0-afcb-e5cbe353ea23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:00.893165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:00.897893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb4dcd7-ed74-43b0-afcb-e5cbe353ea23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-7eb4dcd7-ed74-43b0-afcb-e5cbe353ea23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:00.909633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:00.910726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:00.911728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 7/14] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:00.916797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4dcd7-ed74-43b0-afcb-e5cbe353ea23 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:00.976447 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 8/15] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:04:00.982177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670a10f-1416-4672-8c3a-2c034777e368 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:01.020477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb4dcd7-ed74-43b0-afcb-e5cbe353ea23 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:01.054041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af481fb1-2cd8-4089-9f45-87fe655cc06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:01.054627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af481fb1-2cd8-4089-9f45-87fe655cc06c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:01.054908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af481fb1-2cd8-4089-9f45-87fe655cc06c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:01.055212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af481fb1-2cd8-4089-9f45-87fe655cc06c None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:01.055964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af481fb1-2cd8-4089-9f45-87fe655cc06c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:01.056270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af481fb1-2cd8-4089-9f45-87fe655cc06c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:01.057722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af481fb1-2cd8-4089-9f45-87fe655cc06c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:01.069556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 8/16] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:01.075180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af481fb1-2cd8-4089-9f45-87fe655cc06c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:01.077918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670a10f-1416-4672-8c3a-2c034777e368 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:01.100855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:01.102671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:01.113272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473fde9-9ba7-46a8-ae89-3f45c7d213ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:01.114074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473fde9-9ba7-46a8-ae89-3f45c7d213ef None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:01.114366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473fde9-9ba7-46a8-ae89-3f45c7d213ef None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:01.114646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473fde9-9ba7-46a8-ae89-3f45c7d213ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:01.124607 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473fde9-9ba7-46a8-ae89-3f45c7d213ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:01.126100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473fde9-9ba7-46a8-ae89-3f45c7d213ef None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-1473fde9-9ba7-46a8-ae89-3f45c7d213ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:04:01.146646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:01.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:01.148388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:04:01.148388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:04:01.148388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:04:01.148388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:01.148388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 9/17] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:01.153567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473fde9-9ba7-46a8-ae89-3f45c7d213ef None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:01.177442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af481fb1-2cd8-4089-9f45-87fe655cc06c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:01.211065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09235eba-034b-4246-a608-099c766b5fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:01.211946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09235eba-034b-4246-a608-099c766b5fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:01.212228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09235eba-034b-4246-a608-099c766b5fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:01.212503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09235eba-034b-4246-a608-099c766b5fc3 None admin] PATH_INFO: `/v3/users/9b72d80a668e4df2ad631da1eeae4189` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:01.214058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09235eba-034b-4246-a608-099c766b5fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=9b72d80a668e4df2ad631da1eeae4189)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:01.215556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09235eba-034b-4246-a608-099c766b5fc3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:01.217225 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 9/18] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:01 2022] GET /identity/v3/users/9b72d80a668e4df2ad631da1eeae4189 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:01.223271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09235eba-034b-4246-a608-099c766b5fc3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:01.255801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473fde9-9ba7-46a8-ae89-3f45c7d213ef None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:01.290068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b40ff-b000-4746-a2ec-011bda3817a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:01.290725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b40ff-b000-4746-a2ec-011bda3817a5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:01.291036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b40ff-b000-4746-a2ec-011bda3817a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:01.291317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139b40ff-b000-4746-a2ec-011bda3817a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:01.292042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b40ff-b000-4746-a2ec-011bda3817a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:01.292347 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b40ff-b000-4746-a2ec-011bda3817a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:01.293746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139b40ff-b000-4746-a2ec-011bda3817a5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:01.310442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 10/19] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:01.317428 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:01.324999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09235eba-034b-4246-a608-099c766b5fc3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:01.362942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77579fc9-5baa-4fd8-a484-076ac8186ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:01.363787 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77579fc9-5baa-4fd8-a484-076ac8186ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:01.364076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77579fc9-5baa-4fd8-a484-076ac8186ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:01.364357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77579fc9-5baa-4fd8-a484-076ac8186ec4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:01.365686 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77579fc9-5baa-4fd8-a484-076ac8186ec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:01.367226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77579fc9-5baa-4fd8-a484-076ac8186ec4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:01.368912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 10/20] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:01.374986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b40ff-b000-4746-a2ec-011bda3817a5 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:01.412782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:01.482909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139b40ff-b000-4746-a2ec-011bda3817a5 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:01.516254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54d07b-bccd-4611-b924-0615231b2246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:01.516917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54d07b-bccd-4611-b924-0615231b2246 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:01.517203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54d07b-bccd-4611-b924-0615231b2246 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:01.517481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54d07b-bccd-4611-b924-0615231b2246 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:01.519081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54d07b-bccd-4611-b924-0615231b2246 None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.domain.id=default, user.id=9b72d80a668e4df2ad631da1eeae4189) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:01.519414 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54d07b-bccd-4611-b924-0615231b2246 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:01.520870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54d07b-bccd-4611-b924-0615231b2246 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:01.527839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 11/21] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Jul 21 04:04:01 2022] GET /identity/v3/role_assignments?user.id=9b72d80a668e4df2ad631da1eeae4189&scope.domain.id=default&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 233 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:03.852318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2613-09cf-4c3b-8ab6-6fbe9a373c4a None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:03.853380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2613-09cf-4c3b-8ab6-6fbe9a373c4a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:03.853858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c2613-09cf-4c3b-8ab6-6fbe9a373c4a None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:03.855894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 11/22] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:03.860988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84973241-153e-4c30-84a7-c3d5e406d2ee None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:03.861816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84973241-153e-4c30-84a7-c3d5e406d2ee None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:03.862947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84973241-153e-4c30-84a7-c3d5e406d2ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:03.891781 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-84973241-153e-4c30-84a7-c3d5e406d2ee None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:03.894003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-84973241-153e-4c30-84a7-c3d5e406d2ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:03.984622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 12/23] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:04.022393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c2613-09cf-4c3b-8ab6-6fbe9a373c4a None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:04.055402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a2ddc-72cf-41ed-acfa-f31b7d5eaf61 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.056044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a2ddc-72cf-41ed-acfa-f31b7d5eaf61 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.056537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a2ddc-72cf-41ed-acfa-f31b7d5eaf61 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.058407 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:04.063972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43dec2-545e-4ff2-b9fd-687f00e31893 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.064514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43dec2-545e-4ff2-b9fd-687f00e31893 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.064991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43dec2-545e-4ff2-b9fd-687f00e31893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.095961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-bb43dec2-545e-4ff2-b9fd-687f00e31893 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:04.097787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-bb43dec2-545e-4ff2-b9fd-687f00e31893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:04.134519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:04.185528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 14/25] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:04.187239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f933c0-7f4e-4ddb-8140-ce3981603ad6 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.187726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f933c0-7f4e-4ddb-8140-ce3981603ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.188228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f933c0-7f4e-4ddb-8140-ce3981603ad6 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.189688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 15/26] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:04.191618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b56ee-e967-4797-8d70-edbf27351f59 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.191781 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c2613-09cf-4c3b-8ab6-6fbe9a373c4a None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:04.192188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b56ee-e967-4797-8d70-edbf27351f59 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.192679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00b56ee-e967-4797-8d70-edbf27351f59 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.194932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 16/27] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:04.200916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bfdb9-6b85-4e01-bdcb-53c932592d05 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.201425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bfdb9-6b85-4e01-bdcb-53c932592d05 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.201952 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bfdb9-6b85-4e01-bdcb-53c932592d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.224147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-126bfdb9-6b85-4e01-bdcb-53c932592d05 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:04.225716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-126bfdb9-6b85-4e01-bdcb-53c932592d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:04.250035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd21206-d37d-465b-aa2a-99d4a7dd6096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:04.251073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21206-d37d-465b-aa2a-99d4a7dd6096 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.251517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21206-d37d-465b-aa2a-99d4a7dd6096 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.251927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd21206-d37d-465b-aa2a-99d4a7dd6096 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.272732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd21206-d37d-465b-aa2a-99d4a7dd6096 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:04.274530 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd21206-d37d-465b-aa2a-99d4a7dd6096 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-7bd21206-d37d-465b-aa2a-99d4a7dd6096 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:04:04.295221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:04.296101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:04.296888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:04:04.296888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:04:04.296888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:04:04.296888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:04.298942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 12/28] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:04.305871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a0acc-f1f8-4e81-a2f2-4f9bec62fce0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.306363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a0acc-f1f8-4e81-a2f2-4f9bec62fce0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.306834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28a0acc-f1f8-4e81-a2f2-4f9bec62fce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.310753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 17/29] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:04.311748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bfdb9-6b85-4e01-bdcb-53c932592d05 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:04.325503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-a28a0acc-f1f8-4e81-a2f2-4f9bec62fce0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:04.327031 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a28a0acc-f1f8-4e81-a2f2-4f9bec62fce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:04.338533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:04.409407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 13/30] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:04.410589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a0acc-f1f8-4e81-a2f2-4f9bec62fce0 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:04.444164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:04.459133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bfdb9-6b85-4e01-bdcb-53c932592d05 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:04.499250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f65f7-557e-4b3b-bfd4-6f21dddeb17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:04.500566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f65f7-557e-4b3b-bfd4-6f21dddeb17a None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.501045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f65f7-557e-4b3b-bfd4-6f21dddeb17a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.501705 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8f65f7-557e-4b3b-bfd4-6f21dddeb17a None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.503108 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f65f7-557e-4b3b-bfd4-6f21dddeb17a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:04.504996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8f65f7-557e-4b3b-bfd4-6f21dddeb17a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:04.554853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28a0acc-f1f8-4e81-a2f2-4f9bec62fce0 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:04.597864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65e098-282e-418e-9650-04b7463dbab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:04.598678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65e098-282e-418e-9650-04b7463dbab4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.599128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65e098-282e-418e-9650-04b7463dbab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.599513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e65e098-282e-418e-9650-04b7463dbab4 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.600342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65e098-282e-418e-9650-04b7463dbab4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:04.600746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65e098-282e-418e-9650-04b7463dbab4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:04.602246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e65e098-282e-418e-9650-04b7463dbab4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:04.620866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 14/31] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:04:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:04.626247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65e098-282e-418e-9650-04b7463dbab4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:04.630811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:04.649893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 18/32] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jul 21 04:04:04 2022] POST /identity/v3/roles => generated 225 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:04.651201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f65f7-557e-4b3b-bfd4-6f21dddeb17a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:04.768469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8f65f7-557e-4b3b-bfd4-6f21dddeb17a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:04.800086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e65e098-282e-418e-9650-04b7463dbab4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:04.809428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a703ea-e3a4-421b-abe1-8315ede24919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:04.810636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a703ea-e3a4-421b-abe1-8315ede24919 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.811205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a703ea-e3a4-421b-abe1-8315ede24919 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.811708 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a703ea-e3a4-421b-abe1-8315ede24919 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.826540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a703ea-e3a4-421b-abe1-8315ede24919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-a3a703ea-e3a4-421b-abe1-8315ede24919 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:04.837664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:04.839757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:04.840533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 19/33] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:04.841157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a703ea-e3a4-421b-abe1-8315ede24919 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:04.858697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:04.876025 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d17f2-fb68-4929-b8de-e90c45d169f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:04.877348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d17f2-fb68-4929-b8de-e90c45d169f0 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:04.878665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d17f2-fb68-4929-b8de-e90c45d169f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:04.879154 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d17f2-fb68-4929-b8de-e90c45d169f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:04.880131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d17f2-fb68-4929-b8de-e90c45d169f0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:04.881757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938d17f2-fb68-4929-b8de-e90c45d169f0 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:04.966030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a703ea-e3a4-421b-abe1-8315ede24919 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:05.003878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2809b-0313-44d5-956b-3d268ce53166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:05.004642 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2809b-0313-44d5-956b-3d268ce53166 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.005001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2809b-0313-44d5-956b-3d268ce53166 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.005354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d2809b-0313-44d5-956b-3d268ce53166 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.006150 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2809b-0313-44d5-956b-3d268ce53166 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:05.007989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d2809b-0313-44d5-956b-3d268ce53166 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:05.043578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 20/34] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:04:04 2022] POST /identity/v3/projects => generated 301 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:05.044763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2809b-0313-44d5-956b-3d268ce53166 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:05.051506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 15/35] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jul 21 04:04:04 2022] POST /identity/v3/roles => generated 219 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:05.076637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53f3e-e00a-4c13-95bb-cff2704e93c8 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.077075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53f3e-e00a-4c13-95bb-cff2704e93c8 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.077452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53f3e-e00a-4c13-95bb-cff2704e93c8 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.080148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 16/36] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:05.087018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8137-5372-4477-8d6f-1fb7071dd322 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.087018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8137-5372-4477-8d6f-1fb7071dd322 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.087018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd8137-5372-4477-8d6f-1fb7071dd322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.108360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-2bbd8137-5372-4477-8d6f-1fb7071dd322 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:05.110033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2bbd8137-5372-4477-8d6f-1fb7071dd322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:05.176930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:05.224163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:05.237203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 17/37] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:05.249155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d2809b-0313-44d5-956b-3d268ce53166 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:05.283409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd8137-5372-4477-8d6f-1fb7071dd322 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:05.310499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75991b6f-fea8-47a9-a820-e699bebc6f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:05.311160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991b6f-fea8-47a9-a820-e699bebc6f77 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.311455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991b6f-fea8-47a9-a820-e699bebc6f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.317900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991b6f-fea8-47a9-a820-e699bebc6f77 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.317900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75991b6f-fea8-47a9-a820-e699bebc6f77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:05.317900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75991b6f-fea8-47a9-a820-e699bebc6f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:05.317900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75991b6f-fea8-47a9-a820-e699bebc6f77 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:05.331732 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 21/38] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:05.337068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75991b6f-fea8-47a9-a820-e699bebc6f77 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:05.429516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd8137-5372-4477-8d6f-1fb7071dd322 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:05.469942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e9e15-52ab-4db7-b99a-154b200ba5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:05.470646 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9e15-52ab-4db7-b99a-154b200ba5b2 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.470935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9e15-52ab-4db7-b99a-154b200ba5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.471246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e9e15-52ab-4db7-b99a-154b200ba5b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.472711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9e15-52ab-4db7-b99a-154b200ba5b2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:05.474297 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e9e15-52ab-4db7-b99a-154b200ba5b2 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:05.489956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 18/39] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jul 21 04:04:05 2022] POST /identity/v3/roles => generated 223 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:05.521962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad82e-1ca2-4503-9e9d-5ebba1770166 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.522254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad82e-1ca2-4503-9e9d-5ebba1770166 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.522538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ad82e-1ca2-4503-9e9d-5ebba1770166 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.524188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 19/40] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:05.529918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d197-3c04-4a7f-a73e-c6af5bb8c874 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.530231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d197-3c04-4a7f-a73e-c6af5bb8c874 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.530500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354d197-3c04-4a7f-a73e-c6af5bb8c874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.547954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7354d197-3c04-4a7f-a73e-c6af5bb8c874 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:05.549212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7354d197-3c04-4a7f-a73e-c6af5bb8c874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:05.566493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75991b6f-fea8-47a9-a820-e699bebc6f77 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:05.591636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:05.605036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a772a6-bfb4-4954-a0ae-b26047ffb114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:05.605942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a772a6-bfb4-4954-a0ae-b26047ffb114 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.606257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a772a6-bfb4-4954-a0ae-b26047ffb114 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.606538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a772a6-bfb4-4954-a0ae-b26047ffb114 None admin] PATH_INFO: `/v3/users/9b72d80a668e4df2ad631da1eeae4189` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.607840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a772a6-bfb4-4954-a0ae-b26047ffb114 None admin] RBAC: Authorizing `identity:get_user(user_id=9b72d80a668e4df2ad631da1eeae4189)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:05.608276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:05.609409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a772a6-bfb4-4954-a0ae-b26047ffb114 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:05.611595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 22/41] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:05 2022] GET /identity/v3/users/9b72d80a668e4df2ad631da1eeae4189 => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:05.617137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a772a6-bfb4-4954-a0ae-b26047ffb114 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:05.631295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 20/42] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:05.654108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354d197-3c04-4a7f-a73e-c6af5bb8c874 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:05.724682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a772a6-bfb4-4954-a0ae-b26047ffb114 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:05.759809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4db4eb-cdc8-473e-abe1-31601a7392e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:05.760615 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4db4eb-cdc8-473e-abe1-31601a7392e2 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.760912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4db4eb-cdc8-473e-abe1-31601a7392e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.761197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4db4eb-cdc8-473e-abe1-31601a7392e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.762399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4db4eb-cdc8-473e-abe1-31601a7392e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:05.763908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4db4eb-cdc8-473e-abe1-31601a7392e2 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:05.765552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 23/43] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:05.771228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4db4eb-cdc8-473e-abe1-31601a7392e2 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:05.773435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354d197-3c04-4a7f-a73e-c6af5bb8c874 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:05.807116 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae796f3-6370-4783-bac4-c9c54ccdd82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:05.807907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae796f3-6370-4783-bac4-c9c54ccdd82f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.808193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae796f3-6370-4783-bac4-c9c54ccdd82f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.808469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae796f3-6370-4783-bac4-c9c54ccdd82f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.809649 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae796f3-6370-4783-bac4-c9c54ccdd82f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:05.811141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae796f3-6370-4783-bac4-c9c54ccdd82f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:05.812754 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 21/44] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:05.819072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae796f3-6370-4783-bac4-c9c54ccdd82f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:05.828948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:05.872237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4db4eb-cdc8-473e-abe1-31601a7392e2 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:05.872411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:05.905706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cd7e1-ea84-4088-bf4f-fa5027c270e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:05.906578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cd7e1-ea84-4088-bf4f-fa5027c270e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.906868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cd7e1-ea84-4088-bf4f-fa5027c270e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.907181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cd7e1-ea84-4088-bf4f-fa5027c270e3 None admin] PATH_INFO: `/v3/domains/default/users/9b72d80a668e4df2ad631da1eeae4189/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.909602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cd7e1-ea84-4088-bf4f-fa5027c270e3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=9b72d80a668e4df2ad631da1eeae4189, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:05.911254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cd7e1-ea84-4088-bf4f-fa5027c270e3 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:05.920271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae796f3-6370-4783-bac4-c9c54ccdd82f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:05.925627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 24/45] 10.222.0.48 () {58 vars in 1361 bytes} [Thu Jul 21 04:04:05 2022] PUT /identity/v3/domains/default/users/9b72d80a668e4df2ad631da1eeae4189/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:04:05.958421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a7301-27bb-45d3-9507-c4b1bc3bc6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:05.959142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a7301-27bb-45d3-9507-c4b1bc3bc6a8 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:05.959435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a7301-27bb-45d3-9507-c4b1bc3bc6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:05.959718 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a7301-27bb-45d3-9507-c4b1bc3bc6a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:05.960714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a7301-27bb-45d3-9507-c4b1bc3bc6a8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:05.962238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a7301-27bb-45d3-9507-c4b1bc3bc6a8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:05.993043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 22/46] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:04:05 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:04:07.948314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b21edf-adb6-4fdb-9e17-276a2ee81145 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:07.948826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b21edf-adb6-4fdb-9e17-276a2ee81145 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:07.948905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b21edf-adb6-4fdb-9e17-276a2ee81145 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:07.950243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 25/47] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:07.955511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2a9ff-0b2c-49d5-8367-cb0b59922cd3 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:07.955940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2a9ff-0b2c-49d5-8367-cb0b59922cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:07.956166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2a9ff-0b2c-49d5-8367-cb0b59922cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:07.973549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e9f2a9ff-0b2c-49d5-8367-cb0b59922cd3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:07.974769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e9f2a9ff-0b2c-49d5-8367-cb0b59922cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:08.025644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecab24-31ee-4379-b60f-7aed91616d95 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:08.025936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecab24-31ee-4379-b60f-7aed91616d95 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:08.026221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecab24-31ee-4379-b60f-7aed91616d95 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:08.027633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 26/48] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:08.032513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a107f8-016c-4211-b3e4-0a69cfcd2d6a None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:08.033080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a107f8-016c-4211-b3e4-0a69cfcd2d6a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:08.033365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a107f8-016c-4211-b3e4-0a69cfcd2d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:08.042692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 23/49] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:08.051500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-f2a107f8-016c-4211-b3e4-0a69cfcd2d6a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:08.053032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f2a107f8-016c-4211-b3e4-0a69cfcd2d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:08.067339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2a9ff-0b2c-49d5-8367-cb0b59922cd3 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:08.103042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:08.123302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 27/50] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:08.146930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a107f8-016c-4211-b3e4-0a69cfcd2d6a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:08.171829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2a9ff-0b2c-49d5-8367-cb0b59922cd3 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:08.195193 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:08.210448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53eff2c-7c32-4850-a126-92637dc704e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:08.211239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eff2c-7c32-4850-a126-92637dc704e6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:08.211534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eff2c-7c32-4850-a126-92637dc704e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:08.211821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53eff2c-7c32-4850-a126-92637dc704e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:08.222531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53eff2c-7c32-4850-a126-92637dc704e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-b53eff2c-7c32-4850-a126-92637dc704e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:08.230250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:08.231300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:08.232484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 24/51] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:08.237160 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53eff2c-7c32-4850-a126-92637dc704e6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:08.252020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a107f8-016c-4211-b3e4-0a69cfcd2d6a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:08.290790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96ac8-c75e-4365-b658-082e2b80e001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:08.291613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96ac8-c75e-4365-b658-082e2b80e001 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:08.291894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96ac8-c75e-4365-b658-082e2b80e001 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:08.292168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d96ac8-c75e-4365-b658-082e2b80e001 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:08.293362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d96ac8-c75e-4365-b658-082e2b80e001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:08.294836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d96ac8-c75e-4365-b658-082e2b80e001 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:08.296485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 28/52] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:08.302099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96ac8-c75e-4365-b658-082e2b80e001 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:08.329792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:08.337923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53eff2c-7c32-4850-a126-92637dc704e6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:08.371859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbb2a7-2f41-4c51-8773-1e524ed49215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:08.372540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbb2a7-2f41-4c51-8773-1e524ed49215 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:08.372828 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbb2a7-2f41-4c51-8773-1e524ed49215 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:08.373110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbb2a7-2f41-4c51-8773-1e524ed49215 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:08.373862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbb2a7-2f41-4c51-8773-1e524ed49215 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:08.374175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbb2a7-2f41-4c51-8773-1e524ed49215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:08.375654 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dbb2a7-2f41-4c51-8773-1e524ed49215 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:08.384308 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 25/53] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:08.389784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbb2a7-2f41-4c51-8773-1e524ed49215 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:08.401621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d96ac8-c75e-4365-b658-082e2b80e001 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:08.417709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:08.435990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66aed8-e83b-44f6-aede-35584e56939d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:08.436660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66aed8-e83b-44f6-aede-35584e56939d None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:08.436944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66aed8-e83b-44f6-aede-35584e56939d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:08.437221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66aed8-e83b-44f6-aede-35584e56939d None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:08.437929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66aed8-e83b-44f6-aede-35584e56939d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:08.439436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66aed8-e83b-44f6-aede-35584e56939d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:08.465991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 29/54] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Jul 21 04:04:08 2022] POST /identity/v3/projects => generated 298 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:04:08.494942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbb2a7-2f41-4c51-8773-1e524ed49215 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:08.533188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefb594-d671-42cc-b4d3-1941ee037039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:08.534134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefb594-d671-42cc-b4d3-1941ee037039 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:08.534420 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefb594-d671-42cc-b4d3-1941ee037039 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:08.535216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefb594-d671-42cc-b4d3-1941ee037039 None admin] PATH_INFO: `/v3/users/9b72d80a668e4df2ad631da1eeae4189` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:08.536096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefb594-d671-42cc-b4d3-1941ee037039 None admin] RBAC: Authorizing `identity:get_user(user_id=9b72d80a668e4df2ad631da1eeae4189)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:08.537892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefb594-d671-42cc-b4d3-1941ee037039 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:08.539670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 26/55] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:08 2022] GET /identity/v3/users/9b72d80a668e4df2ad631da1eeae4189 => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:08.545372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66aed8-e83b-44f6-aede-35584e56939d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:08.652507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66aed8-e83b-44f6-aede-35584e56939d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:08.684889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b331ec5-01ba-4752-9637-840f24934873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:08.685682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b331ec5-01ba-4752-9637-840f24934873 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:08.685966 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b331ec5-01ba-4752-9637-840f24934873 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:08.686240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b331ec5-01ba-4752-9637-840f24934873 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:08.687429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b331ec5-01ba-4752-9637-840f24934873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:08.688893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b331ec5-01ba-4752-9637-840f24934873 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:08.691235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 30/56] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:08.697223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefb594-d671-42cc-b4d3-1941ee037039 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:08.827961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:08.911385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefb594-d671-42cc-b4d3-1941ee037039 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:08.944316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da583e3-31fd-49ce-a0b9-7c5f4a503f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:08.944979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da583e3-31fd-49ce-a0b9-7c5f4a503f69 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:08.945268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da583e3-31fd-49ce-a0b9-7c5f4a503f69 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:08.945548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da583e3-31fd-49ce-a0b9-7c5f4a503f69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:08.946395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da583e3-31fd-49ce-a0b9-7c5f4a503f69 None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.domain.id=default, user.id=9b72d80a668e4df2ad631da1eeae4189) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:08.946715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da583e3-31fd-49ce-a0b9-7c5f4a503f69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:08.948230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da583e3-31fd-49ce-a0b9-7c5f4a503f69 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:08.957449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 27/57] 10.222.0.48 () {56 vars in 1322 bytes} [Thu Jul 21 04:04:08 2022] GET /identity/v3/role_assignments?user.id=9b72d80a668e4df2ad631da1eeae4189&scope.domain.id=default&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 530 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:10.491292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ce147-3925-4ce5-8219-9e2a2a05e74e None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:10.491774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ce147-3925-4ce5-8219-9e2a2a05e74e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:10.491774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ce147-3925-4ce5-8219-9e2a2a05e74e None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:10.493157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 31/58] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:10.498200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9545fb-bd08-4dc3-989e-67a7609eefcb None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:10.498609 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9545fb-bd08-4dc3-989e-67a7609eefcb None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:10.498776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9545fb-bd08-4dc3-989e-67a7609eefcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:10.516624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-fe9545fb-bd08-4dc3-989e-67a7609eefcb None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:10.517833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fe9545fb-bd08-4dc3-989e-67a7609eefcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:10.582453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 28/59] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:10.607442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ce147-3925-4ce5-8219-9e2a2a05e74e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:10.643256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:10.706885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ce147-3925-4ce5-8219-9e2a2a05e74e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:10.740043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab198e-f102-4e75-99ec-4e38d68ea1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:10.740826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab198e-f102-4e75-99ec-4e38d68ea1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:10.741113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab198e-f102-4e75-99ec-4e38d68ea1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:10.741443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab198e-f102-4e75-99ec-4e38d68ea1b1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:10.742571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab198e-f102-4e75-99ec-4e38d68ea1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:10.744055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab198e-f102-4e75-99ec-4e38d68ea1b1 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:10.745659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 32/60] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:10.751263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9545fb-bd08-4dc3-989e-67a7609eefcb None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:10.769006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:10.846185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9545fb-bd08-4dc3-989e-67a7609eefcb None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:10.879477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353ac92-5683-46c9-863f-9271d35deb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:10.880140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ac92-5683-46c9-863f-9271d35deb72 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:10.880424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ac92-5683-46c9-863f-9271d35deb72 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:10.880702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353ac92-5683-46c9-863f-9271d35deb72 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:10.881411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353ac92-5683-46c9-863f-9271d35deb72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:10.882859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353ac92-5683-46c9-863f-9271d35deb72 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:10.906670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 29/61] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:10 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:13.980143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b095db-5b8a-4bc3-b873-cb1d6abd6637 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:13.981161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b095db-5b8a-4bc3-b873-cb1d6abd6637 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:13.981706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b095db-5b8a-4bc3-b873-cb1d6abd6637 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:13.983777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 33/62] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:13.989881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf98c-02c7-451d-9168-e02d032b8274 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:13.990721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf98c-02c7-451d-9168-e02d032b8274 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:13.991244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bf98c-02c7-451d-9168-e02d032b8274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.015984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-867bf98c-02c7-451d-9168-e02d032b8274 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:14.017545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-867bf98c-02c7-451d-9168-e02d032b8274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:14.101111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 30/63] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:14.143203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b095db-5b8a-4bc3-b873-cb1d6abd6637 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:14.302038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b095db-5b8a-4bc3-b873-cb1d6abd6637 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:14.304948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:14.320445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e52c7-f3d6-498d-83e0-d848667f0154 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.320772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e52c7-f3d6-498d-83e0-d848667f0154 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.321020 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e52c7-f3d6-498d-83e0-d848667f0154 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.322599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 31/64] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:14.327761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00011f-c933-4ac0-adb5-fac2ea8f2c52 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.328055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00011f-c933-4ac0-adb5-fac2ea8f2c52 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.328339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00011f-c933-4ac0-adb5-fac2ea8f2c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.335870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:14.351986 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-bc00011f-c933-4ac0-adb5-fac2ea8f2c52 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:14.353519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bc00011f-c933-4ac0-adb5-fac2ea8f2c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:14.360248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb499fe-2647-4922-b745-5917ff3c5b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:14.361068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb499fe-2647-4922-b745-5917ff3c5b9f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.361360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb499fe-2647-4922-b745-5917ff3c5b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.361644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb499fe-2647-4922-b745-5917ff3c5b9f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.390082 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb499fe-2647-4922-b745-5917ff3c5b9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-dcb499fe-2647-4922-b745-5917ff3c5b9f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:14.398841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:14.399967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:14.400918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:14.405030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 34/65] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:14.406443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df187-2b74-4c88-83b2-b1b4838817a2 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.406688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df187-2b74-4c88-83b2-b1b4838817a2 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.406993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444df187-2b74-4c88-83b2-b1b4838817a2 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.408386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 35/66] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:14.411337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df187-2b74-4c88-83b2-b1b4838817a2 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:14.437742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 32/67] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:14.439781 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4491f-446d-4567-94ae-16ed23c930d7 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.440547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4491f-446d-4567-94ae-16ed23c930d7 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.441544 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4491f-446d-4567-94ae-16ed23c930d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.465687 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-83a4491f-446d-4567-94ae-16ed23c930d7 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:14.467226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-83a4491f-446d-4567-94ae-16ed23c930d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:14.537357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444df187-2b74-4c88-83b2-b1b4838817a2 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:14.562194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 33/68] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:14.563086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4491f-446d-4567-94ae-16ed23c930d7 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:14.583790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253ae09-1e33-4d19-8ccf-dde5c70d44d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:14.584508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253ae09-1e33-4d19-8ccf-dde5c70d44d5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.584800 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253ae09-1e33-4d19-8ccf-dde5c70d44d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.586184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253ae09-1e33-4d19-8ccf-dde5c70d44d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.586184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253ae09-1e33-4d19-8ccf-dde5c70d44d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:14.586540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253ae09-1e33-4d19-8ccf-dde5c70d44d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:14.587996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253ae09-1e33-4d19-8ccf-dde5c70d44d5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:14.598024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 36/69] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:14.600282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c827b-09cf-4a51-9751-e45ad20b3cc1 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.600576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c827b-09cf-4a51-9751-e45ad20b3cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.600857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c827b-09cf-4a51-9751-e45ad20b3cc1 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.602282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 37/70] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:14.606333 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c827b-09cf-4a51-9751-e45ad20b3cc1 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:14.631086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:14.636279 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:14.674753 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4491f-446d-4567-94ae-16ed23c930d7 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:14.708457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c827b-09cf-4a51-9751-e45ad20b3cc1 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:14.709944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40cafd-eb11-464f-a78b-d9f2a62de690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:14.711754 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40cafd-eb11-464f-a78b-d9f2a62de690 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.712047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40cafd-eb11-464f-a78b-d9f2a62de690 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.712330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd40cafd-eb11-464f-a78b-d9f2a62de690 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.723108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd40cafd-eb11-464f-a78b-d9f2a62de690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-cd40cafd-eb11-464f-a78b-d9f2a62de690 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:14.730784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:14.731983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 34/71] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:14.732852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40cafd-eb11-464f-a78b-d9f2a62de690 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:14.745727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd3f521-9fc1-4ebe-9d10-753272674bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:14.746528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f521-9fc1-4ebe-9d10-753272674bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.746819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f521-9fc1-4ebe-9d10-753272674bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.747135 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd3f521-9fc1-4ebe-9d10-753272674bf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.757947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd3f521-9fc1-4ebe-9d10-753272674bf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-2fd3f521-9fc1-4ebe-9d10-753272674bf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:14.765574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:14.766417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:14.767608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 38/72] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:14.768410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c3ea-81d7-4fc1-8439-85d883183320 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.768410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c3ea-81d7-4fc1-8439-85d883183320 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.768547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87c3ea-81d7-4fc1-8439-85d883183320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.784941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2a87c3ea-81d7-4fc1-8439-85d883183320 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:14.786123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2a87c3ea-81d7-4fc1-8439-85d883183320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:14.834986 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd40cafd-eb11-464f-a78b-d9f2a62de690 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:14.854562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 39/73] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:14.855927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48ab0-a2d0-4caf-a35a-496f09382da8 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.856222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48ab0-a2d0-4caf-a35a-496f09382da8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.856500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f48ab0-a2d0-4caf-a35a-496f09382da8 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.861837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 40/74] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:14.861837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f48ab0-a2d0-4caf-a35a-496f09382da8 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:14.862409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:14.876026 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87109fe7-c2e6-4168-a41b-02e56267a529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:14.876904 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87109fe7-c2e6-4168-a41b-02e56267a529 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:14.877193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87109fe7-c2e6-4168-a41b-02e56267a529 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:14.877472 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87109fe7-c2e6-4168-a41b-02e56267a529 None admin] PATH_INFO: `/v3/users/f869ee38ef2a44d298334f947030268e` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:14.879661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:14.893111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87109fe7-c2e6-4168-a41b-02e56267a529 None admin] RBAC: Authorizing `identity:get_user(user_id=f869ee38ef2a44d298334f947030268e)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:14.894755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87109fe7-c2e6-4168-a41b-02e56267a529 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:14.896575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 35/75] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:14 2022] GET /identity/v3/users/f869ee38ef2a44d298334f947030268e => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:14.897347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87109fe7-c2e6-4168-a41b-02e56267a529 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:14.969146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f48ab0-a2d0-4caf-a35a-496f09382da8 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:14.994204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87109fe7-c2e6-4168-a41b-02e56267a529 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.004458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6eff5f-b8d7-4048-8e6a-c26c3f71859a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.005130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eff5f-b8d7-4048-8e6a-c26c3f71859a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.005419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eff5f-b8d7-4048-8e6a-c26c3f71859a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.005809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6eff5f-b8d7-4048-8e6a-c26c3f71859a None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.006577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6eff5f-b8d7-4048-8e6a-c26c3f71859a None admin] RBAC: Adding query filter params (name=member) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:15.006889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6eff5f-b8d7-4048-8e6a-c26c3f71859a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.008330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6eff5f-b8d7-4048-8e6a-c26c3f71859a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.016296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 41/76] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:15.017468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae581-367b-4da7-a2a8-c3bab9f03117 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.017763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae581-367b-4da7-a2a8-c3bab9f03117 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.018144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ae581-367b-4da7-a2a8-c3bab9f03117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.028419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49434aaa-3bf4-49ef-ab72-20202918d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.029088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49434aaa-3bf4-49ef-ab72-20202918d536 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.029374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49434aaa-3bf4-49ef-ab72-20202918d536 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.029715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49434aaa-3bf4-49ef-ab72-20202918d536 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.030532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49434aaa-3bf4-49ef-ab72-20202918d536 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:15.030846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49434aaa-3bf4-49ef-ab72-20202918d536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.032270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49434aaa-3bf4-49ef-ab72-20202918d536 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.033909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-009ae581-367b-4da7-a2a8-c3bab9f03117 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:15.035520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-009ae581-367b-4da7-a2a8-c3bab9f03117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:15.040502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 36/77] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:15.041296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49434aaa-3bf4-49ef-ab72-20202918d536 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.087563 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:15.102067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 42/78] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:15.103195 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ae581-367b-4da7-a2a8-c3bab9f03117 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.119644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:15.147195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49434aaa-3bf4-49ef-ab72-20202918d536 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.179917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c738fc-43ef-4976-81a9-a57eb043b949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.180726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c738fc-43ef-4976-81a9-a57eb043b949 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.181015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c738fc-43ef-4976-81a9-a57eb043b949 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.181297 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c738fc-43ef-4976-81a9-a57eb043b949 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.192998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c738fc-43ef-4976-81a9-a57eb043b949 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f4c738fc-43ef-4976-81a9-a57eb043b949 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:15.201131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:15.201981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:15.202822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 37/79] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:15.203509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c738fc-43ef-4976-81a9-a57eb043b949 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.215243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ae581-367b-4da7-a2a8-c3bab9f03117 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.250226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd07a6-ef71-4735-83dd-5ebc4d4a9574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.250875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd07a6-ef71-4735-83dd-5ebc4d4a9574 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.251195 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd07a6-ef71-4735-83dd-5ebc4d4a9574 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.251482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdd07a6-ef71-4735-83dd-5ebc4d4a9574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.307036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c738fc-43ef-4976-81a9-a57eb043b949 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.309253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:15.318391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd07a6-ef71-4735-83dd-5ebc4d4a9574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.319946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdd07a6-ef71-4735-83dd-5ebc4d4a9574 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.329423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:15.341209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a52363-5291-436b-967e-d428a49b1733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.342028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a52363-5291-436b-967e-d428a49b1733 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.342313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a52363-5291-436b-967e-d428a49b1733 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.342592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a52363-5291-436b-967e-d428a49b1733 None admin] PATH_INFO: `/v3/users/f869ee38ef2a44d298334f947030268e` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.343827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a52363-5291-436b-967e-d428a49b1733 None admin] RBAC: Authorizing `identity:get_user(user_id=f869ee38ef2a44d298334f947030268e)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.345274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a52363-5291-436b-967e-d428a49b1733 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.347441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 38/80] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/users/f869ee38ef2a44d298334f947030268e => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:15.348468 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a52363-5291-436b-967e-d428a49b1733 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.419501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 43/81] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:15.420344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd07a6-ef71-4735-83dd-5ebc4d4a9574 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.447992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a52363-5291-436b-967e-d428a49b1733 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.481218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cee86-2219-4a7f-b4e8-917dfb4f9b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.482105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cee86-2219-4a7f-b4e8-917dfb4f9b5c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.482416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cee86-2219-4a7f-b4e8-917dfb4f9b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.482672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412cee86-2219-4a7f-b4e8-917dfb4f9b5c None admin] PATH_INFO: `/v3/users/9b72d80a668e4df2ad631da1eeae4189` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.483932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cee86-2219-4a7f-b4e8-917dfb4f9b5c None admin] RBAC: Authorizing `identity:get_user(user_id=9b72d80a668e4df2ad631da1eeae4189)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.485407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412cee86-2219-4a7f-b4e8-917dfb4f9b5c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.487082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 39/82] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/users/9b72d80a668e4df2ad631da1eeae4189 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:15.488483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cee86-2219-4a7f-b4e8-917dfb4f9b5c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.521363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdd07a6-ef71-4735-83dd-5ebc4d4a9574 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.528633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:15.531677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:15.556983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819e0e5-8428-48e1-aba5-74945f836f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.557780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819e0e5-8428-48e1-aba5-74945f836f4f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.558071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819e0e5-8428-48e1-aba5-74945f836f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.558342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2819e0e5-8428-48e1-aba5-74945f836f4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.559551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819e0e5-8428-48e1-aba5-74945f836f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.561019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2819e0e5-8428-48e1-aba5-74945f836f4f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.562643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 44/83] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:15.563433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819e0e5-8428-48e1-aba5-74945f836f4f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.595367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412cee86-2219-4a7f-b4e8-917dfb4f9b5c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.631321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad735a6-f095-42bc-b28f-91ce013c4019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.632270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad735a6-f095-42bc-b28f-91ce013c4019 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.632692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad735a6-f095-42bc-b28f-91ce013c4019 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.633034 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad735a6-f095-42bc-b28f-91ce013c4019 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.633856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad735a6-f095-42bc-b28f-91ce013c4019 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:15.634229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad735a6-f095-42bc-b28f-91ce013c4019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.636019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad735a6-f095-42bc-b28f-91ce013c4019 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.645067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 40/84] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:15.645972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad735a6-f095-42bc-b28f-91ce013c4019 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.672817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2819e0e5-8428-48e1-aba5-74945f836f4f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.713434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf5f44-76ac-4a14-9da2-79affa7321aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.714096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf5f44-76ac-4a14-9da2-79affa7321aa None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.714388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf5f44-76ac-4a14-9da2-79affa7321aa None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.714682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf5f44-76ac-4a14-9da2-79affa7321aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.760190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad735a6-f095-42bc-b28f-91ce013c4019 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.761197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:15.761998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:15.788704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf5f44-76ac-4a14-9da2-79affa7321aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.790215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf5f44-76ac-4a14-9da2-79affa7321aa None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.794980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e478d8-6dce-420d-88f9-ba982930a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.795852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e478d8-6dce-420d-88f9-ba982930a14e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.796268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e478d8-6dce-420d-88f9-ba982930a14e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.796553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e478d8-6dce-420d-88f9-ba982930a14e None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.797753 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e478d8-6dce-420d-88f9-ba982930a14e None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:15.799216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e478d8-6dce-420d-88f9-ba982930a14e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:15.801723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 41/85] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:15.802492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e478d8-6dce-420d-88f9-ba982930a14e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.897971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 45/86] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:15.898592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf5f44-76ac-4a14-9da2-79affa7321aa None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:15.922938 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e478d8-6dce-420d-88f9-ba982930a14e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.957424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70306b9-ee63-4e2d-aa50-981c11cf41d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:15.958064 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70306b9-ee63-4e2d-aa50-981c11cf41d6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:15.958351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70306b9-ee63-4e2d-aa50-981c11cf41d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:15.958629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70306b9-ee63-4e2d-aa50-981c11cf41d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:15.976119 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:15.999220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf5f44-76ac-4a14-9da2-79affa7321aa None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:15.999661 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:16.029307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70306b9-ee63-4e2d-aa50-981c11cf41d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:16.030832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70306b9-ee63-4e2d-aa50-981c11cf41d6 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:16.034081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12e501-6bb3-42f2-a7d4-48e7aa763c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:16.035303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12e501-6bb3-42f2-a7d4-48e7aa763c13 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:16.035589 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12e501-6bb3-42f2-a7d4-48e7aa763c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:16.035868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f12e501-6bb3-42f2-a7d4-48e7aa763c13 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:16.036582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12e501-6bb3-42f2-a7d4-48e7aa763c13 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:16.038025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f12e501-6bb3-42f2-a7d4-48e7aa763c13 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:16.063864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 46/87] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:15 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:16.064681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12e501-6bb3-42f2-a7d4-48e7aa763c13 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:16.150240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 42/88] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:16.151569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70306b9-ee63-4e2d-aa50-981c11cf41d6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:16.195530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f12e501-6bb3-42f2-a7d4-48e7aa763c13 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:16.232957 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:16.243489 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:16.243770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d442aae-d9d1-47e8-b809-5bdd4936359a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:16.245461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d442aae-d9d1-47e8-b809-5bdd4936359a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:16.246532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d442aae-d9d1-47e8-b809-5bdd4936359a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:16.246532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d442aae-d9d1-47e8-b809-5bdd4936359a None admin] PATH_INFO: `/v3/users/f869ee38ef2a44d298334f947030268e` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:16.247650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d442aae-d9d1-47e8-b809-5bdd4936359a None admin] RBAC: Authorizing `identity:get_user(user_id=f869ee38ef2a44d298334f947030268e)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:16.249138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d442aae-d9d1-47e8-b809-5bdd4936359a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:16.250791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 47/89] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:16 2022] GET /identity/v3/users/f869ee38ef2a44d298334f947030268e => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:16.252587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d442aae-d9d1-47e8-b809-5bdd4936359a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:16.281097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70306b9-ee63-4e2d-aa50-981c11cf41d6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:16.327445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce0de9-7228-4831-b57d-5eadd7b500ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:16.328112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce0de9-7228-4831-b57d-5eadd7b500ad None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:16.328401 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce0de9-7228-4831-b57d-5eadd7b500ad None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:16.328683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce0de9-7228-4831-b57d-5eadd7b500ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:16.329535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce0de9-7228-4831-b57d-5eadd7b500ad None admin] RBAC: Adding query filter params (role.id=49806c1799404d039cb4e2a11f1d4442, scope.project.id=6a4c69c73a874668837daa9a9951b335, user.id=f869ee38ef2a44d298334f947030268e) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:16.329852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce0de9-7228-4831-b57d-5eadd7b500ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:16.331641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce0de9-7228-4831-b57d-5eadd7b500ad None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:16.340263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 43/90] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:16 2022] GET /identity/v3/role_assignments?user.id=f869ee38ef2a44d298334f947030268e&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:16.341119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce0de9-7228-4831-b57d-5eadd7b500ad None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:16.380919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d442aae-d9d1-47e8-b809-5bdd4936359a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:16.424164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265dfaf-a311-4fd2-9950-46c120b3c38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:16.425090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265dfaf-a311-4fd2-9950-46c120b3c38e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:16.425463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265dfaf-a311-4fd2-9950-46c120b3c38e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:16.425761 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c265dfaf-a311-4fd2-9950-46c120b3c38e None admin] PATH_INFO: `/v3/projects/9ccbe5d4f51a43819452f5b2ee6d0a47` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:16.427248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265dfaf-a311-4fd2-9950-46c120b3c38e None admin] RBAC: Authorizing `identity:get_project(project_id=9ccbe5d4f51a43819452f5b2ee6d0a47)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:16.428770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c265dfaf-a311-4fd2-9950-46c120b3c38e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:16.432902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 48/91] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:16 2022] GET /identity/v3/projects/9ccbe5d4f51a43819452f5b2ee6d0a47 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:16.434293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265dfaf-a311-4fd2-9950-46c120b3c38e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:16.484993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce0de9-7228-4831-b57d-5eadd7b500ad None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:16.526433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7390ad-4dd0-4557-b781-7eaee3c8ef3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:16.527414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7390ad-4dd0-4557-b781-7eaee3c8ef3d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:16.527655 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7390ad-4dd0-4557-b781-7eaee3c8ef3d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:16.527944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7390ad-4dd0-4557-b781-7eaee3c8ef3d None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:16.529167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7390ad-4dd0-4557-b781-7eaee3c8ef3d None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:16.530632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7390ad-4dd0-4557-b781-7eaee3c8ef3d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:16.532529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:16.532643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 44/92] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:16 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:16.534117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7390ad-4dd0-4557-b781-7eaee3c8ef3d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:16.540256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:16.570526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c265dfaf-a311-4fd2-9950-46c120b3c38e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:16.648095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f41698-05ef-4d94-b9c7-393e2793111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:16.648765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f41698-05ef-4d94-b9c7-393e2793111e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:16.649054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f41698-05ef-4d94-b9c7-393e2793111e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:16.649335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f41698-05ef-4d94-b9c7-393e2793111e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:16.711596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7390ad-4dd0-4557-b781-7eaee3c8ef3d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:16.778826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a912d61-0def-4729-a433-e9e649be766c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:16.779577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912d61-0def-4729-a433-e9e649be766c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:16.779866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912d61-0def-4729-a433-e9e649be766c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:16.780195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a912d61-0def-4729-a433-e9e649be766c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:16.781052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a912d61-0def-4729-a433-e9e649be766c None admin] RBAC: Adding query filter params (role.id=49806c1799404d039cb4e2a11f1d4442, scope.project.id=9ccbe5d4f51a43819452f5b2ee6d0a47, user.id=f869ee38ef2a44d298334f947030268e) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:16.781368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a912d61-0def-4729-a433-e9e649be766c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:16.782838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a912d61-0def-4729-a433-e9e649be766c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:16.794207 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 45/93] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:16 2022] GET /identity/v3/role_assignments?user.id=f869ee38ef2a44d298334f947030268e&scope.project.id=9ccbe5d4f51a43819452f5b2ee6d0a47&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:16.795075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a912d61-0def-4729-a433-e9e649be766c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:16.815816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f41698-05ef-4d94-b9c7-393e2793111e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:16.817720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f41698-05ef-4d94-b9c7-393e2793111e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:16.906160 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:16.993036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a912d61-0def-4729-a433-e9e649be766c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:16.999348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:17.007881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 49/94] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:17.016375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f41698-05ef-4d94-b9c7-393e2793111e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:17.056396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f458e9-e2ac-459a-afd4-1a05afa449d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:17.057082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f458e9-e2ac-459a-afd4-1a05afa449d4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:17.057377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f458e9-e2ac-459a-afd4-1a05afa449d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:17.057661 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f458e9-e2ac-459a-afd4-1a05afa449d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:17.058518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f458e9-e2ac-459a-afd4-1a05afa449d4 None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=6a4c69c73a874668837daa9a9951b335, user.id=9b72d80a668e4df2ad631da1eeae4189) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:17.058948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f458e9-e2ac-459a-afd4-1a05afa449d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:17.060456 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f458e9-e2ac-459a-afd4-1a05afa449d4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:17.066887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 46/95] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:16 2022] GET /identity/v3/role_assignments?user.id=9b72d80a668e4df2ad631da1eeae4189&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 259 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:17.189064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f41698-05ef-4d94-b9c7-393e2793111e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:17.243752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58b4a1-5e18-493b-a7e4-beb4127ecf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:17.244946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58b4a1-5e18-493b-a7e4-beb4127ecf21 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:17.245430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58b4a1-5e18-493b-a7e4-beb4127ecf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:17.245920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58b4a1-5e18-493b-a7e4-beb4127ecf21 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:17.247397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58b4a1-5e18-493b-a7e4-beb4127ecf21 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:17.249081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58b4a1-5e18-493b-a7e4-beb4127ecf21 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:17.251034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 50/96] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:17 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:17.257736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f458e9-e2ac-459a-afd4-1a05afa449d4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:17.419564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f458e9-e2ac-459a-afd4-1a05afa449d4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:17.459517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:17.465469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce071ee7-6752-4238-99be-c8dff4879018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:17.466139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce071ee7-6752-4238-99be-c8dff4879018 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:17.466433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce071ee7-6752-4238-99be-c8dff4879018 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:17.466744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce071ee7-6752-4238-99be-c8dff4879018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:17.467653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce071ee7-6752-4238-99be-c8dff4879018 None admin] RBAC: Adding query filter params (role.id=b29b8d5f31b44d8b90eb10c34acbc06a, scope.project.id=6a4c69c73a874668837daa9a9951b335, user.id=f869ee38ef2a44d298334f947030268e) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:17.467977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce071ee7-6752-4238-99be-c8dff4879018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:17.469503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce071ee7-6752-4238-99be-c8dff4879018 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:17.476725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 47/97] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:17 2022] GET /identity/v3/role_assignments?user.id=f869ee38ef2a44d298334f947030268e&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=b29b8d5f31b44d8b90eb10c34acbc06a => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:18.941589 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2c10c-e719-4df9-b2ec-7d3640dd0696 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:18.942913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2c10c-e719-4df9-b2ec-7d3640dd0696 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:18.943444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2c10c-e719-4df9-b2ec-7d3640dd0696 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:18.945031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 51/98] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:18.950714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed148e7c-a8cf-4a6a-a46f-6a3c8acac259 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:18.951591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed148e7c-a8cf-4a6a-a46f-6a3c8acac259 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:18.952067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed148e7c-a8cf-4a6a-a46f-6a3c8acac259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:18.979065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-ed148e7c-a8cf-4a6a-a46f-6a3c8acac259 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:18.980610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ed148e7c-a8cf-4a6a-a46f-6a3c8acac259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:18.991186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e799d32-0cb3-4d7a-bdde-ffbe56389158 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:18.991481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e799d32-0cb3-4d7a-bdde-ffbe56389158 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:18.991772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e799d32-0cb3-4d7a-bdde-ffbe56389158 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:18.993161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 52/99] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:18.999117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c925a-8f68-43eb-84df-2be1639c8650 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:18.999415 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c925a-8f68-43eb-84df-2be1639c8650 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:18.999698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c925a-8f68-43eb-84df-2be1639c8650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.024068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-af2c925a-8f68-43eb-84df-2be1639c8650 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:19.025289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-af2c925a-8f68-43eb-84df-2be1639c8650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:19.065276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 48/100] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:19.072909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:19.091038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed148e7c-a8cf-4a6a-a46f-6a3c8acac259 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:19.136683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 53/101] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:19.167950 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c925a-8f68-43eb-84df-2be1639c8650 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:19.278968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed148e7c-a8cf-4a6a-a46f-6a3c8acac259 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:19.339076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c925a-8f68-43eb-84df-2be1639c8650 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:19.344007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:19.367706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42710c-7d0d-4313-8b13-c323629f321e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:19.368534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42710c-7d0d-4313-8b13-c323629f321e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.368823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42710c-7d0d-4313-8b13-c323629f321e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.369103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d42710c-7d0d-4313-8b13-c323629f321e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.383987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a7b0-4acb-4329-8065-de7cea546f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:19.385105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a7b0-4acb-4329-8065-de7cea546f30 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.385314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d42710c-7d0d-4313-8b13-c323629f321e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:19.385786 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a7b0-4acb-4329-8065-de7cea546f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.386259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d94a7b0-4acb-4329-8065-de7cea546f30 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0d42710c-7d0d-4313-8b13-c323629f321e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:19.398979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:19.399855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:19.400690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 49/102] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:19.401307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42710c-7d0d-4313-8b13-c323629f321e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:19.416078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d94a7b0-4acb-4329-8065-de7cea546f30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-9d94a7b0-4acb-4329-8065-de7cea546f30 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:19.428924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:19.429796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:19.430564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:19.432953 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 54/103] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:19.438993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a7b0-4acb-4329-8065-de7cea546f30 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:19.485974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:19.600547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d42710c-7d0d-4313-8b13-c323629f321e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:19.654862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d94a7b0-4acb-4329-8065-de7cea546f30 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:19.666560 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bfe127-2159-4040-a2a0-9b6e7ee59c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:19.667668 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe127-2159-4040-a2a0-9b6e7ee59c4b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.667958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe127-2159-4040-a2a0-9b6e7ee59c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.668510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bfe127-2159-4040-a2a0-9b6e7ee59c4b None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.669277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfe127-2159-4040-a2a0-9b6e7ee59c4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:19.669589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfe127-2159-4040-a2a0-9b6e7ee59c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:19.671977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bfe127-2159-4040-a2a0-9b6e7ee59c4b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:19.687979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 50/104] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:19.689315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad0e8a-686c-4bdb-b525-09e4dda498b5 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.689604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad0e8a-686c-4bdb-b525-09e4dda498b5 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.689883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad0e8a-686c-4bdb-b525-09e4dda498b5 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.692808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 51/105] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:19.699777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad0e8a-686c-4bdb-b525-09e4dda498b5 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:19.714593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43add5bf-77e6-4583-91ab-69ea5d90df83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:19.715293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43add5bf-77e6-4583-91ab-69ea5d90df83 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.715577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43add5bf-77e6-4583-91ab-69ea5d90df83 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.715855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43add5bf-77e6-4583-91ab-69ea5d90df83 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.716609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43add5bf-77e6-4583-91ab-69ea5d90df83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:19.716918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43add5bf-77e6-4583-91ab-69ea5d90df83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:19.718573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43add5bf-77e6-4583-91ab-69ea5d90df83 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:19.732328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 55/106] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:19.734458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cef5e-c01c-4d9c-86c4-d044d4631e6b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.734745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cef5e-c01c-4d9c-86c4-d044d4631e6b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.735044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875cef5e-c01c-4d9c-86c4-d044d4631e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.766872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-875cef5e-c01c-4d9c-86c4-d044d4631e6b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:19.768089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-875cef5e-c01c-4d9c-86c4-d044d4631e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:19.791344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:19.868462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad0e8a-686c-4bdb-b525-09e4dda498b5 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:19.870806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 56/107] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:19.871773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cef5e-c01c-4d9c-86c4-d044d4631e6b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:19.908449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:19.922517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c9cb-b3f7-4204-97c4-5323db0adeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:19.923431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c9cb-b3f7-4204-97c4-5323db0adeaf None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.923723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c9cb-b3f7-4204-97c4-5323db0adeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.924002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c9cb-b3f7-4204-97c4-5323db0adeaf None admin] PATH_INFO: `/v3/users/50163bec976647dfb62081328a6725cd` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.938640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658c9cb-b3f7-4204-97c4-5323db0adeaf None admin] RBAC: Authorizing `identity:get_user(user_id=50163bec976647dfb62081328a6725cd)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:19.940179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658c9cb-b3f7-4204-97c4-5323db0adeaf None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:19.941943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 52/108] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:19 2022] GET /identity/v3/users/50163bec976647dfb62081328a6725cd => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:19.947341 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669bc7b-7303-4f10-95f4-e266c3de628f None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:19.947650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669bc7b-7303-4f10-95f4-e266c3de628f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:19.947940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669bc7b-7303-4f10-95f4-e266c3de628f None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:19.949266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 53/109] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:19.949988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669bc7b-7303-4f10-95f4-e266c3de628f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.004743 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875cef5e-c01c-4d9c-86c4-d044d4631e6b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.042246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43155122-a87a-468b-8b4f-01af9d158148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.043158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43155122-a87a-468b-8b4f-01af9d158148 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.043448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43155122-a87a-468b-8b4f-01af9d158148 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.043728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43155122-a87a-468b-8b4f-01af9d158148 None admin] PATH_INFO: `/v3/users/f869ee38ef2a44d298334f947030268e` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.045248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43155122-a87a-468b-8b4f-01af9d158148 None admin] RBAC: Authorizing `identity:get_user(user_id=f869ee38ef2a44d298334f947030268e)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.046811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43155122-a87a-468b-8b4f-01af9d158148 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.048958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 57/110] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:19 2022] GET /identity/v3/users/f869ee38ef2a44d298334f947030268e => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:20.049782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43155122-a87a-468b-8b4f-01af9d158148 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.089376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669bc7b-7303-4f10-95f4-e266c3de628f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.092560 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.127770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d80c9b6-ae22-4d0f-96bc-407c66ca079a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.128541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80c9b6-ae22-4d0f-96bc-407c66ca079a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.129049 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80c9b6-ae22-4d0f-96bc-407c66ca079a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.129232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d80c9b6-ae22-4d0f-96bc-407c66ca079a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.140553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d80c9b6-ae22-4d0f-96bc-407c66ca079a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:20.142825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-7d80c9b6-ae22-4d0f-96bc-407c66ca079a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:20.149069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:20.149959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:20.150720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 54/111] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:20.152059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf8b9-c0e5-438c-988a-e831df912cf7 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.152059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf8b9-c0e5-438c-988a-e831df912cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.152207 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fdf8b9-c0e5-438c-988a-e831df912cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.165762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43155122-a87a-468b-8b4f-01af9d158148 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.169634 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c6fdf8b9-c0e5-438c-988a-e831df912cf7 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:20.170840 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c6fdf8b9-c0e5-438c-988a-e831df912cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:20.204815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d3fc8-70f0-415e-9ffd-ab31d8a3fc3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.205468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3fc8-70f0-415e-9ffd-ab31d8a3fc3f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.205914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3fc8-70f0-415e-9ffd-ab31d8a3fc3f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.206344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d3fc8-70f0-415e-9ffd-ab31d8a3fc3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.253617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 55/112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:20.254872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf8b9-c0e5-438c-988a-e831df912cf7 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.290320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d3fc8-70f0-415e-9ffd-ab31d8a3fc3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.292158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d3fc8-70f0-415e-9ffd-ab31d8a3fc3f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.356905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.363698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fdf8b9-c0e5-438c-988a-e831df912cf7 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.385168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.399826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c63db-028b-430d-9e34-b1158062fc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.400707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c63db-028b-430d-9e34-b1158062fc95 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.400991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c63db-028b-430d-9e34-b1158062fc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.401270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c63db-028b-430d-9e34-b1158062fc95 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.402471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c63db-028b-430d-9e34-b1158062fc95 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.407587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 58/113] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:20.407736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c63db-028b-430d-9e34-b1158062fc95 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.407815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1deae-4173-4bf8-887b-498da4387c03 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.407815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1deae-4173-4bf8-887b-498da4387c03 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.407815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1deae-4173-4bf8-887b-498da4387c03 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.407983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 56/114] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:20.408058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 59/115] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:20.408058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1deae-4173-4bf8-887b-498da4387c03 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.414946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c63db-028b-430d-9e34-b1158062fc95 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.510852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1deae-4173-4bf8-887b-498da4387c03 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.515391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c63db-028b-430d-9e34-b1158062fc95 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.544943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71386723-427b-4803-96ee-f25e6435f085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.545728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71386723-427b-4803-96ee-f25e6435f085 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.546017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71386723-427b-4803-96ee-f25e6435f085 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.546296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71386723-427b-4803-96ee-f25e6435f085 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.547470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71386723-427b-4803-96ee-f25e6435f085 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.548080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c7d11-19ca-4fc5-8304-c366f47b541f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.548751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c7d11-19ca-4fc5-8304-c366f47b541f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.548951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71386723-427b-4803-96ee-f25e6435f085 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.549036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c7d11-19ca-4fc5-8304-c366f47b541f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.549310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c7d11-19ca-4fc5-8304-c366f47b541f None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.550068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c7d11-19ca-4fc5-8304-c366f47b541f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:20.550382 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c7d11-19ca-4fc5-8304-c366f47b541f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.550624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 60/116] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:20.551419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71386723-427b-4803-96ee-f25e6435f085 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.551813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c7d11-19ca-4fc5-8304-c366f47b541f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.561557 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 57/117] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:20.562395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c7d11-19ca-4fc5-8304-c366f47b541f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.590930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.607209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.650831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71386723-427b-4803-96ee-f25e6435f085 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.664816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c7d11-19ca-4fc5-8304-c366f47b541f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.685153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a121675a-9779-4aac-8e7b-e05ff127f905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.686272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121675a-9779-4aac-8e7b-e05ff127f905 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.686559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121675a-9779-4aac-8e7b-e05ff127f905 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.686836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121675a-9779-4aac-8e7b-e05ff127f905 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.688065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121675a-9779-4aac-8e7b-e05ff127f905 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.689526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a121675a-9779-4aac-8e7b-e05ff127f905 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.691788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 61/118] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:20.692963 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff4d3f-e07f-41bd-975e-320019b1330b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.693253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff4d3f-e07f-41bd-975e-320019b1330b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.693534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ff4d3f-e07f-41bd-975e-320019b1330b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.701222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2de516-0bf8-40c1-9a21-99d8cec3590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.702111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de516-0bf8-40c1-9a21-99d8cec3590e None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.702403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de516-0bf8-40c1-9a21-99d8cec3590e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.702681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2de516-0bf8-40c1-9a21-99d8cec3590e None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335/users/f869ee38ef2a44d298334f947030268e/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.704690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2de516-0bf8-40c1-9a21-99d8cec3590e None admin] RBAC: Authorizing `identity:create_grant(project_id=6a4c69c73a874668837daa9a9951b335, user_id=f869ee38ef2a44d298334f947030268e, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.706130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2de516-0bf8-40c1-9a21-99d8cec3590e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.709935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d6ff4d3f-e07f-41bd-975e-320019b1330b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:20.711442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d6ff4d3f-e07f-41bd-975e-320019b1330b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:20.720538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 58/119] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:20 2022] PUT /identity/v3/projects/6a4c69c73a874668837daa9a9951b335/users/f869ee38ef2a44d298334f947030268e/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:20.721802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd0937-7b8b-4fb0-ae94-ded5caa77ae4 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.722124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd0937-7b8b-4fb0-ae94-ded5caa77ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.722779 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd0937-7b8b-4fb0-ae94-ded5caa77ae4 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.723903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 59/120] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:20.727166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd0937-7b8b-4fb0-ae94-ded5caa77ae4 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.797113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 62/121] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:20.798142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff4d3f-e07f-41bd-975e-320019b1330b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.845556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.863525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:20.868569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd0937-7b8b-4fb0-ae94-ded5caa77ae4 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.908556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abc5c7-9b5a-400a-a161-b71eabb2b357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.909155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abc5c7-9b5a-400a-a161-b71eabb2b357 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.909449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abc5c7-9b5a-400a-a161-b71eabb2b357 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.910353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89abc5c7-9b5a-400a-a161-b71eabb2b357 None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.911120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abc5c7-9b5a-400a-a161-b71eabb2b357 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.912604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89abc5c7-9b5a-400a-a161-b71eabb2b357 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.923928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ff4d3f-e07f-41bd-975e-320019b1330b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:20.940702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 60/122] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:04:20 2022] POST /identity/v3/projects => generated 302 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:20.941906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abc5c7-9b5a-400a-a161-b71eabb2b357 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:20.967191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3b261-87c5-430a-9237-e93cb4d0ca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:20.968269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b261-87c5-430a-9237-e93cb4d0ca87 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.968683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b261-87c5-430a-9237-e93cb4d0ca87 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.969054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3b261-87c5-430a-9237-e93cb4d0ca87 None admin] PATH_INFO: `/v3/users/9b72d80a668e4df2ad631da1eeae4189` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.970660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3b261-87c5-430a-9237-e93cb4d0ca87 None admin] RBAC: Authorizing `identity:get_user(user_id=9b72d80a668e4df2ad631da1eeae4189)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:20.972983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3b261-87c5-430a-9237-e93cb4d0ca87 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:20.974947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 63/123] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/users/9b72d80a668e4df2ad631da1eeae4189 => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:20.976697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3a5e9-4049-4445-bffe-b31dd51d52de None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:20.977033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3a5e9-4049-4445-bffe-b31dd51d52de None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:20.977394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef3a5e9-4049-4445-bffe-b31dd51d52de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:20.997509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fef3a5e9-4049-4445-bffe-b31dd51d52de None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:20.998934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fef3a5e9-4049-4445-bffe-b31dd51d52de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:21.087209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 64/124] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:21.092112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89abc5c7-9b5a-400a-a161-b71eabb2b357 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:21.093056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3a5e9-4049-4445-bffe-b31dd51d52de None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:21.140224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac4169-b7a4-43f4-97c9-96172fa7cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:21.141440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4169-b7a4-43f4-97c9-96172fa7cb89 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:21.141440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4169-b7a4-43f4-97c9-96172fa7cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:21.141440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ac4169-b7a4-43f4-97c9-96172fa7cb89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:21.142280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac4169-b7a4-43f4-97c9-96172fa7cb89 None admin] RBAC: Adding query filter params (role.id=7103b531aa6246d7b44730f73395761f, scope.project.id=6a4c69c73a874668837daa9a9951b335, user.id=50163bec976647dfb62081328a6725cd) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:21.142602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac4169-b7a4-43f4-97c9-96172fa7cb89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:21.144792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ac4169-b7a4-43f4-97c9-96172fa7cb89 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:21.148900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:21.153690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 61/125] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:20 2022] GET /identity/v3/role_assignments?user.id=50163bec976647dfb62081328a6725cd&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=7103b531aa6246d7b44730f73395761f => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:21.155044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac4169-b7a4-43f4-97c9-96172fa7cb89 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:21.163289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:21.246906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef3a5e9-4049-4445-bffe-b31dd51d52de None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:21.289903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078df54-0ecc-4a1b-a71c-b6b42083caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:21.290782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078df54-0ecc-4a1b-a71c-b6b42083caa6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:21.291103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078df54-0ecc-4a1b-a71c-b6b42083caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:21.291382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078df54-0ecc-4a1b-a71c-b6b42083caa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:21.308128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078df54-0ecc-4a1b-a71c-b6b42083caa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-9078df54-0ecc-4a1b-a71c-b6b42083caa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:21.317964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:21.318880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:21.319990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 65/126] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:21.322987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078df54-0ecc-4a1b-a71c-b6b42083caa6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:21.330179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ac4169-b7a4-43f4-97c9-96172fa7cb89 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:21.374050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e48289-9a7b-4155-a503-4ce5b9b96fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:21.374928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48289-9a7b-4155-a503-4ce5b9b96fda None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:21.375259 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48289-9a7b-4155-a503-4ce5b9b96fda None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:21.375539 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e48289-9a7b-4155-a503-4ce5b9b96fda None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:21.376751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e48289-9a7b-4155-a503-4ce5b9b96fda None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:21.378302 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e48289-9a7b-4155-a503-4ce5b9b96fda None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:21.381026 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 62/127] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:21 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:21.381898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e48289-9a7b-4155-a503-4ce5b9b96fda None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:21.447745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078df54-0ecc-4a1b-a71c-b6b42083caa6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:21.460253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:21.499134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df5af6-1d71-42a4-a451-9ead79b9e3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:21.499967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df5af6-1d71-42a4-a451-9ead79b9e3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:21.500259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df5af6-1d71-42a4-a451-9ead79b9e3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:21.500542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df5af6-1d71-42a4-a451-9ead79b9e3c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:21.512192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:21.530242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8df5af6-1d71-42a4-a451-9ead79b9e3c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f8df5af6-1d71-42a4-a451-9ead79b9e3c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:21.539684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:21.540562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:21.541324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:21.551657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 66/128] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:21.552361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df5af6-1d71-42a4-a451-9ead79b9e3c3 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:21.580078 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e48289-9a7b-4155-a503-4ce5b9b96fda None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:21.657184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fcd78-025f-4145-bd94-419f5caa8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:21.657859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fcd78-025f-4145-bd94-419f5caa8773 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:21.658145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fcd78-025f-4145-bd94-419f5caa8773 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:21.658425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fcd78-025f-4145-bd94-419f5caa8773 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:21.659267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fcd78-025f-4145-bd94-419f5caa8773 None admin] RBAC: Adding query filter params (name=member) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:21.659607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fcd78-025f-4145-bd94-419f5caa8773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:21.661301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fcd78-025f-4145-bd94-419f5caa8773 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:21.678768 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 63/129] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:21.681130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fcd78-025f-4145-bd94-419f5caa8773 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:21.692889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8df5af6-1d71-42a4-a451-9ead79b9e3c3 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:21.739789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245699a2-e19f-4c3a-ab06-fabbdeb4af52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:21.740608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245699a2-e19f-4c3a-ab06-fabbdeb4af52 None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:21.740894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245699a2-e19f-4c3a-ab06-fabbdeb4af52 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:21.741170 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245699a2-e19f-4c3a-ab06-fabbdeb4af52 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335/users/9b72d80a668e4df2ad631da1eeae4189/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:21.743376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245699a2-e19f-4c3a-ab06-fabbdeb4af52 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a4c69c73a874668837daa9a9951b335, user_id=9b72d80a668e4df2ad631da1eeae4189, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:21.744854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245699a2-e19f-4c3a-ab06-fabbdeb4af52 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:21.778008 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 67/130] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:21 2022] PUT /identity/v3/projects/6a4c69c73a874668837daa9a9951b335/users/9b72d80a668e4df2ad631da1eeae4189/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:21.779306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245699a2-e19f-4c3a-ab06-fabbdeb4af52 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:21.853237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:21.887863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fcd78-025f-4145-bd94-419f5caa8773 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:21.922277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:21.930881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b84c2-4b67-425b-aee9-b3dcf2b66c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:21.931669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b84c2-4b67-425b-aee9-b3dcf2b66c53 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:21.931958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b84c2-4b67-425b-aee9-b3dcf2b66c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:21.932236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383b84c2-4b67-425b-aee9-b3dcf2b66c53 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:21.933004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b84c2-4b67-425b-aee9-b3dcf2b66c53 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:21.933315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b84c2-4b67-425b-aee9-b3dcf2b66c53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:21.934751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383b84c2-4b67-425b-aee9-b3dcf2b66c53 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:21.945436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 64/131] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:21.950503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b84c2-4b67-425b-aee9-b3dcf2b66c53 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:22.053655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245699a2-e19f-4c3a-ab06-fabbdeb4af52 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:22.075640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383b84c2-4b67-425b-aee9-b3dcf2b66c53 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:22.120530 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be16ae8-1c26-49b7-aabf-cbc74cf189f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:22.121418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16ae8-1c26-49b7-aabf-cbc74cf189f5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:22.121703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16ae8-1c26-49b7-aabf-cbc74cf189f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:22.121985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be16ae8-1c26-49b7-aabf-cbc74cf189f5 None admin] PATH_INFO: `/v3/users/f869ee38ef2a44d298334f947030268e` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:22.127871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be16ae8-1c26-49b7-aabf-cbc74cf189f5 None admin] RBAC: Authorizing `identity:get_user(user_id=f869ee38ef2a44d298334f947030268e)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:22.131085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be16ae8-1c26-49b7-aabf-cbc74cf189f5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:22.131761 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a4efe-d1a6-4612-a6c6-02c221a4fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:22.132656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a4efe-d1a6-4612-a6c6-02c221a4fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:22.132942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a4efe-d1a6-4612-a6c6-02c221a4fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:22.133218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294a4efe-d1a6-4612-a6c6-02c221a4fdd0 None admin] PATH_INFO: `/v3/users/f869ee38ef2a44d298334f947030268e` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:22.134398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 65/132] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:21 2022] GET /identity/v3/users/f869ee38ef2a44d298334f947030268e => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:22.138976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a4efe-d1a6-4612-a6c6-02c221a4fdd0 None admin] RBAC: Authorizing `identity:get_user(user_id=f869ee38ef2a44d298334f947030268e)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:22.138976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294a4efe-d1a6-4612-a6c6-02c221a4fdd0 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:22.138976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 68/133] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:21 2022] GET /identity/v3/users/f869ee38ef2a44d298334f947030268e => generated 275 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:22.143477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be16ae8-1c26-49b7-aabf-cbc74cf189f5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:22.145005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a4efe-d1a6-4612-a6c6-02c221a4fdd0 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:22.245138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:22.271853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:22.277448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294a4efe-d1a6-4612-a6c6-02c221a4fdd0 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:22.317982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788d749-2e33-4918-ad6a-8e861b7e0379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:22.319413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788d749-2e33-4918-ad6a-8e861b7e0379 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:22.319925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788d749-2e33-4918-ad6a-8e861b7e0379 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:22.320405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c788d749-2e33-4918-ad6a-8e861b7e0379 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:22.321815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788d749-2e33-4918-ad6a-8e861b7e0379 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:22.323927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c788d749-2e33-4918-ad6a-8e861b7e0379 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:22.325850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 69/134] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:22 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:22.329104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be16ae8-1c26-49b7-aabf-cbc74cf189f5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:22.332127 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788d749-2e33-4918-ad6a-8e861b7e0379 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:22.419106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fe0c1-2c41-41b8-a727-328ca58c7f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:22.420267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fe0c1-2c41-41b8-a727-328ca58c7f29 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:22.420267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fe0c1-2c41-41b8-a727-328ca58c7f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:22.420542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101fe0c1-2c41-41b8-a727-328ca58c7f29 None admin] PATH_INFO: `/v3/projects/9ccbe5d4f51a43819452f5b2ee6d0a47` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:22.421749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fe0c1-2c41-41b8-a727-328ca58c7f29 None admin] RBAC: Authorizing `identity:get_project(project_id=9ccbe5d4f51a43819452f5b2ee6d0a47)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:22.431327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101fe0c1-2c41-41b8-a727-328ca58c7f29 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:22.433321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 66/135] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:22 2022] GET /identity/v3/projects/9ccbe5d4f51a43819452f5b2ee6d0a47 => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:22.438778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fe0c1-2c41-41b8-a727-328ca58c7f29 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:22.447442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c788d749-2e33-4918-ad6a-8e861b7e0379 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:22.488735 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cac6f5-3bbc-4c11-9006-dc86866cd1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:22.492637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac6f5-3bbc-4c11-9006-dc86866cd1a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:22.493154 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac6f5-3bbc-4c11-9006-dc86866cd1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:22.493658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cac6f5-3bbc-4c11-9006-dc86866cd1a1 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335/users/f869ee38ef2a44d298334f947030268e/roles/b29b8d5f31b44d8b90eb10c34acbc06a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:22.498804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cac6f5-3bbc-4c11-9006-dc86866cd1a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a4c69c73a874668837daa9a9951b335, user_id=f869ee38ef2a44d298334f947030268e, role_id=b29b8d5f31b44d8b90eb10c34acbc06a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:22.500573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cac6f5-3bbc-4c11-9006-dc86866cd1a1 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:22.533431 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 70/136] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:22 2022] PUT /identity/v3/projects/6a4c69c73a874668837daa9a9951b335/users/f869ee38ef2a44d298334f947030268e/roles/b29b8d5f31b44d8b90eb10c34acbc06a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:04:22.597058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101fe0c1-2c41-41b8-a727-328ca58c7f29 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:22.627978 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:22.637695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef1b70-5aa6-47c1-acad-e498fd6198bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:22.639073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef1b70-5aa6-47c1-acad-e498fd6198bd None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:22.639574 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef1b70-5aa6-47c1-acad-e498fd6198bd None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:22.640059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef1b70-5aa6-47c1-acad-e498fd6198bd None admin] PATH_INFO: `/v3/projects/9ccbe5d4f51a43819452f5b2ee6d0a47/users/f869ee38ef2a44d298334f947030268e/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:22.642449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef1b70-5aa6-47c1-acad-e498fd6198bd None admin] RBAC: Authorizing `identity:create_grant(project_id=9ccbe5d4f51a43819452f5b2ee6d0a47, user_id=f869ee38ef2a44d298334f947030268e, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:22.644270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef1b70-5aa6-47c1-acad-e498fd6198bd None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:22.658392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 67/137] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:22 2022] PUT /identity/v3/projects/9ccbe5d4f51a43819452f5b2ee6d0a47/users/f869ee38ef2a44d298334f947030268e/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:04:23.400086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd46825-defb-463a-8217-a122a4dcbb20 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.401111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd46825-defb-463a-8217-a122a4dcbb20 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.401627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd46825-defb-463a-8217-a122a4dcbb20 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.403601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 71/138] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:23.408720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a08f4e-f437-4307-945c-e7a2c55ad292 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.409585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a08f4e-f437-4307-945c-e7a2c55ad292 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.410717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a08f4e-f437-4307-945c-e7a2c55ad292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.436083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-42a08f4e-f437-4307-945c-e7a2c55ad292 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:23.437611 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-42a08f4e-f437-4307-945c-e7a2c55ad292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:23.529246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 68/139] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:23.564632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd46825-defb-463a-8217-a122a4dcbb20 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:23.605069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:23.700282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd46825-defb-463a-8217-a122a4dcbb20 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:23.743551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16940a-bbd9-4137-a90a-8ebdf0840572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:23.744753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16940a-bbd9-4137-a90a-8ebdf0840572 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.745285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16940a-bbd9-4137-a90a-8ebdf0840572 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.745773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16940a-bbd9-4137-a90a-8ebdf0840572 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.762537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16940a-bbd9-4137-a90a-8ebdf0840572 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-1b16940a-bbd9-4137-a90a-8ebdf0840572 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:23.771181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:23.772101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:23.772888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:23.775333 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 72/140] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:23.781182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a08f4e-f437-4307-945c-e7a2c55ad292 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:23.898414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a08f4e-f437-4307-945c-e7a2c55ad292 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:23.918662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:23.942796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9856c9e0-7fd2-4a3b-8a7d-0902e13183a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:23.943861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c9e0-7fd2-4a3b-8a7d-0902e13183a7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.944369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c9e0-7fd2-4a3b-8a7d-0902e13183a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.944838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9856c9e0-7fd2-4a3b-8a7d-0902e13183a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.945798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856c9e0-7fd2-4a3b-8a7d-0902e13183a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:23.946307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856c9e0-7fd2-4a3b-8a7d-0902e13183a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:23.947956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9856c9e0-7fd2-4a3b-8a7d-0902e13183a7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:23.961704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 69/141] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:23.967310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16940a-bbd9-4137-a90a-8ebdf0840572 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:23.981613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c006-e68b-4d16-b009-4619f1104aed None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.981929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c006-e68b-4d16-b009-4619f1104aed None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.982175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426c006-e68b-4d16-b009-4619f1104aed None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:23.983595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 70/142] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:23.998223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ac16-755c-4bdc-af14-7750a978acd5 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:23.998514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ac16-755c-4bdc-af14-7750a978acd5 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:23.998785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11ac16-755c-4bdc-af14-7750a978acd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.028023 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-5a11ac16-755c-4bdc-af14-7750a978acd5 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:24.029234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5a11ac16-755c-4bdc-af14-7750a978acd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:24.099785 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:24.146679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16940a-bbd9-4137-a90a-8ebdf0840572 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:24.236801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 71/143] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:24.260138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11ac16-755c-4bdc-af14-7750a978acd5 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.269822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625202a3-a968-4488-b0b0-0a88b95c3a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:24.271158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625202a3-a968-4488-b0b0-0a88b95c3a43 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.271664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625202a3-a968-4488-b0b0-0a88b95c3a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.272601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625202a3-a968-4488-b0b0-0a88b95c3a43 None admin] PATH_INFO: `/v3/users/f869ee38ef2a44d298334f947030268e` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.277179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625202a3-a968-4488-b0b0-0a88b95c3a43 None admin] RBAC: Authorizing `identity:get_user(user_id=f869ee38ef2a44d298334f947030268e)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:24.279005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625202a3-a968-4488-b0b0-0a88b95c3a43 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:24.281509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 73/144] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:23 2022] GET /identity/v3/users/f869ee38ef2a44d298334f947030268e => generated 275 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:24.288059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625202a3-a968-4488-b0b0-0a88b95c3a43 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.458374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11ac16-755c-4bdc-af14-7750a978acd5 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:24.470654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625202a3-a968-4488-b0b0-0a88b95c3a43 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:24.483283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:24.528079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe1efb-a45b-42f7-8c08-b7b21fa24540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:24.528845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe1efb-a45b-42f7-8c08-b7b21fa24540 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.529125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe1efb-a45b-42f7-8c08-b7b21fa24540 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.529917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe1efb-a45b-42f7-8c08-b7b21fa24540 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.536151 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42095468-c6a6-4fed-a9eb-c6871edc4df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:24.536809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095468-c6a6-4fed-a9eb-c6871edc4df2 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.537096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095468-c6a6-4fed-a9eb-c6871edc4df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.537375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42095468-c6a6-4fed-a9eb-c6871edc4df2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.556039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe1efb-a45b-42f7-8c08-b7b21fa24540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-7dfe1efb-a45b-42f7-8c08-b7b21fa24540 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:24.567966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:24.568846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:24.569603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:24.572104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 72/145] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:24.573808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732abd77-bbad-4acc-8a48-df23895137d3 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.574301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732abd77-bbad-4acc-8a48-df23895137d3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.574776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732abd77-bbad-4acc-8a48-df23895137d3 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.576392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 73/146] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:24.582182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732abd77-bbad-4acc-8a48-df23895137d3 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.583604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:24.630444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42095468-c6a6-4fed-a9eb-c6871edc4df2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:24.631847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42095468-c6a6-4fed-a9eb-c6871edc4df2 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:24.714445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732abd77-bbad-4acc-8a48-df23895137d3 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:24.733357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 74/147] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:24.739614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f580-1066-446b-a0a0-2e3e864ada89 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.739614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f580-1066-446b-a0a0-2e3e864ada89 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.739614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5005f580-1066-446b-a0a0-2e3e864ada89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.760579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c4414-7dd1-47f9-8fde-a5f9b40fcaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:24.761686 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4414-7dd1-47f9-8fde-a5f9b40fcaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:24.762179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4414-7dd1-47f9-8fde-a5f9b40fcaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:24.762660 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c4414-7dd1-47f9-8fde-a5f9b40fcaf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:24.763689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c4414-7dd1-47f9-8fde-a5f9b40fcaf6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:24.764215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c4414-7dd1-47f9-8fde-a5f9b40fcaf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:24.765883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04c4414-7dd1-47f9-8fde-a5f9b40fcaf6 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:24.776487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 74/148] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:24.777668 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c4414-7dd1-47f9-8fde-a5f9b40fcaf6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.787059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-5005f580-1066-446b-a0a0-2e3e864ada89 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:24.788213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-5005f580-1066-446b-a0a0-2e3e864ada89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:24.859338 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:24.860720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:24.874734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 75/149] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:24.875521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f580-1066-446b-a0a0-2e3e864ada89 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:24.991314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04c4414-7dd1-47f9-8fde-a5f9b40fcaf6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.016707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5005f580-1066-446b-a0a0-2e3e864ada89 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.027613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90b8d-9d34-48cc-8a1a-c0a628e5efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.028680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90b8d-9d34-48cc-8a1a-c0a628e5efc9 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.029181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90b8d-9d34-48cc-8a1a-c0a628e5efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.029651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def90b8d-9d34-48cc-8a1a-c0a628e5efc9 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.031193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def90b8d-9d34-48cc-8a1a-c0a628e5efc9 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.032916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def90b8d-9d34-48cc-8a1a-c0a628e5efc9 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.035395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 75/150] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:24 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:25.036352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90b8d-9d34-48cc-8a1a-c0a628e5efc9 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:25.062985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f43946-ce8c-472e-999e-534403766e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.063828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f43946-ce8c-472e-999e-534403766e3c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.064118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f43946-ce8c-472e-999e-534403766e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.064398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f43946-ce8c-472e-999e-534403766e3c None admin] PATH_INFO: `/v3/users/50163bec976647dfb62081328a6725cd` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.065661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f43946-ce8c-472e-999e-534403766e3c None admin] RBAC: Authorizing `identity:get_user(user_id=50163bec976647dfb62081328a6725cd)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.067417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f43946-ce8c-472e-999e-534403766e3c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.069204 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 76/151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:24 2022] GET /identity/v3/users/50163bec976647dfb62081328a6725cd => generated 289 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:25.074991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d7bf0-2c30-4ff7-ba30-1e4cc7dc99ee None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.075295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d7bf0-2c30-4ff7-ba30-1e4cc7dc99ee None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.075582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d7bf0-2c30-4ff7-ba30-1e4cc7dc99ee None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.077004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 77/152] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:25.081224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d7bf0-2c30-4ff7-ba30-1e4cc7dc99ee None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:25.137147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:25.149318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:25.152407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def90b8d-9d34-48cc-8a1a-c0a628e5efc9 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.189819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed297a-bd7c-4400-893d-6d0310180c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.190825 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed297a-bd7c-4400-893d-6d0310180c6c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.191723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed297a-bd7c-4400-893d-6d0310180c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.192101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed297a-bd7c-4400-893d-6d0310180c6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.193452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed297a-bd7c-4400-893d-6d0310180c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.195056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed297a-bd7c-4400-893d-6d0310180c6c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.196853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 76/153] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:25.197900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed297a-bd7c-4400-893d-6d0310180c6c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:25.207632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d7bf0-2c30-4ff7-ba30-1e4cc7dc99ee None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.246288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e1f09b-d7f1-49eb-aaa9-3c156276c569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.247286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1f09b-d7f1-49eb-aaa9-3c156276c569 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.247778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1f09b-d7f1-49eb-aaa9-3c156276c569 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.248249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e1f09b-d7f1-49eb-aaa9-3c156276c569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.249267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1f09b-d7f1-49eb-aaa9-3c156276c569 None admin] RBAC: Adding query filter params (role.id=49806c1799404d039cb4e2a11f1d4442, scope.project.id=6a4c69c73a874668837daa9a9951b335, user.id=f869ee38ef2a44d298334f947030268e) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:25.249758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1f09b-d7f1-49eb-aaa9-3c156276c569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.251426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e1f09b-d7f1-49eb-aaa9-3c156276c569 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.257935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 78/154] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:25 2022] GET /identity/v3/role_assignments?user.id=f869ee38ef2a44d298334f947030268e&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:25.259565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff152-125b-4c0a-86d4-5bbf3abb2a00 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.260103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff152-125b-4c0a-86d4-5bbf3abb2a00 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.260558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cff152-125b-4c0a-86d4-5bbf3abb2a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.279579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b0cff152-125b-4c0a-86d4-5bbf3abb2a00 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:25.281149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b0cff152-125b-4c0a-86d4-5bbf3abb2a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:25.310629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed297a-bd7c-4400-893d-6d0310180c6c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.350589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339bad4-c9bc-4980-964d-184681906212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.351459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339bad4-c9bc-4980-964d-184681906212 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.351744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339bad4-c9bc-4980-964d-184681906212 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.352023 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0339bad4-c9bc-4980-964d-184681906212 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.353345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339bad4-c9bc-4980-964d-184681906212 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.354914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0339bad4-c9bc-4980-964d-184681906212 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.357095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 77/155] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:25 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:25.357867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339bad4-c9bc-4980-964d-184681906212 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:25.365079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 79/156] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:25.366281 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cff152-125b-4c0a-86d4-5bbf3abb2a00 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:25.417519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:25.418967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:25.490144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cff152-125b-4c0a-86d4-5bbf3abb2a00 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.502810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0339bad4-c9bc-4980-964d-184681906212 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.534879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe1fae-985f-43a4-a323-9c713e962d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.536301 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1fae-985f-43a4-a323-9c713e962d9e None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.537508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1fae-985f-43a4-a323-9c713e962d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.537958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe1fae-985f-43a4-a323-9c713e962d9e None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335/users/50163bec976647dfb62081328a6725cd/roles/7103b531aa6246d7b44730f73395761f` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.541811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe1fae-985f-43a4-a323-9c713e962d9e None admin] RBAC: Authorizing `identity:create_grant(project_id=6a4c69c73a874668837daa9a9951b335, user_id=50163bec976647dfb62081328a6725cd, role_id=7103b531aa6246d7b44730f73395761f)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.543328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfe1fae-985f-43a4-a323-9c713e962d9e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.555334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449a1785-6bab-4bb3-af8b-f784b9a6f482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.556011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a1785-6bab-4bb3-af8b-f784b9a6f482 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.556296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a1785-6bab-4bb3-af8b-f784b9a6f482 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.556564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449a1785-6bab-4bb3-af8b-f784b9a6f482 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.557291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a1785-6bab-4bb3-af8b-f784b9a6f482 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:25.558758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449a1785-6bab-4bb3-af8b-f784b9a6f482 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:25.565180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 80/157] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:25 2022] PUT /identity/v3/projects/6a4c69c73a874668837daa9a9951b335/users/50163bec976647dfb62081328a6725cd/roles/7103b531aa6246d7b44730f73395761f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:25.569012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447d890-01db-4b11-9023-6c69e4be3ff4 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.570018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447d890-01db-4b11-9023-6c69e4be3ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.570487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6447d890-01db-4b11-9023-6c69e4be3ff4 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.573224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 81/158] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:25.575989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447d890-01db-4b11-9023-6c69e4be3ff4 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:25.586086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 78/159] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:25 2022] POST /identity/v3/users => generated 283 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:25.589691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12057-8078-44ee-b2cd-65e57d3ea741 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.590218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12057-8078-44ee-b2cd-65e57d3ea741 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.590675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a12057-8078-44ee-b2cd-65e57d3ea741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.631253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-73a12057-8078-44ee-b2cd-65e57d3ea741 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:25.634880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-73a12057-8078-44ee-b2cd-65e57d3ea741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:25.787811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 79/160] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:25.789524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283400b8-6f7d-4938-bbc2-2047e037d6b8 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.790008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283400b8-6f7d-4938-bbc2-2047e037d6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.790291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283400b8-6f7d-4938-bbc2-2047e037d6b8 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.791619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 80/161] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:25.798785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91a684-cbc5-4547-8a46-b0df756ab863 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.799100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91a684-cbc5-4547-8a46-b0df756ab863 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.799380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91a684-cbc5-4547-8a46-b0df756ab863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.801922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6447d890-01db-4b11-9023-6c69e4be3ff4 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:25.810776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:25.823731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-8c91a684-cbc5-4547-8a46-b0df756ab863 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:25.825245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8c91a684-cbc5-4547-8a46-b0df756ab863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:25.844938 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:25.850362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ea149-66ac-4eca-9c01-f45c85f363d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:25.851440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ea149-66ac-4eca-9c01-f45c85f363d3 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:25.851566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ea149-66ac-4eca-9c01-f45c85f363d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:25.851744 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ea149-66ac-4eca-9c01-f45c85f363d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:25.862673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9ea149-66ac-4eca-9c01-f45c85f363d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-6c9ea149-66ac-4eca-9c01-f45c85f363d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:25.870683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:25.871706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:25.872590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 82/162] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:25.873467 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ea149-66ac-4eca-9c01-f45c85f363d3 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:25.912832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 81/163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:25.913757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91a684-cbc5-4547-8a46-b0df756ab863 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:26.011374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ea149-66ac-4eca-9c01-f45c85f363d3 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:26.047808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91a684-cbc5-4547-8a46-b0df756ab863 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:26.054028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef9d1-c794-4f9e-a42f-be92e581d475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:26.054861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef9d1-c794-4f9e-a42f-be92e581d475 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:26.055692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef9d1-c794-4f9e-a42f-be92e581d475 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:26.055692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0ef9d1-c794-4f9e-a42f-be92e581d475 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:26.069297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0ef9d1-c794-4f9e-a42f-be92e581d475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-6c0ef9d1-c794-4f9e-a42f-be92e581d475 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:26.080340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:26.081278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 83/164] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:26.082671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef9d1-c794-4f9e-a42f-be92e581d475 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:26.095480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e732-b27e-42f3-9ac3-6e34cb11646b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:26.096190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e732-b27e-42f3-9ac3-6e34cb11646b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:26.096476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e732-b27e-42f3-9ac3-6e34cb11646b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:26.096757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642e732-b27e-42f3-9ac3-6e34cb11646b None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:26.098347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642e732-b27e-42f3-9ac3-6e34cb11646b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:26.098659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642e732-b27e-42f3-9ac3-6e34cb11646b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:26.100330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642e732-b27e-42f3-9ac3-6e34cb11646b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:26.109540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 82/165] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:26.110454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e732-b27e-42f3-9ac3-6e34cb11646b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:26.123095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:26.128257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:26.232018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0ef9d1-c794-4f9e-a42f-be92e581d475 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:26.266907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642e732-b27e-42f3-9ac3-6e34cb11646b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:26.280044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2a743-e30f-4505-9b11-16acb6de81a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:26.281083 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2a743-e30f-4505-9b11-16acb6de81a8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:26.281536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2a743-e30f-4505-9b11-16acb6de81a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:26.281958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2a743-e30f-4505-9b11-16acb6de81a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:26.295215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af2a743-e30f-4505-9b11-16acb6de81a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-0af2a743-e30f-4505-9b11-16acb6de81a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:26.304951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:26.305962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:26.306940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:26.308921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051b9f-40c5-4082-afb7-112c166c6e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:26.309700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051b9f-40c5-4082-afb7-112c166c6e9c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:26.310039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051b9f-40c5-4082-afb7-112c166c6e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:26.310196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 84/166] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:26.310407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02051b9f-40c5-4082-afb7-112c166c6e9c None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:26.311275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02051b9f-40c5-4082-afb7-112c166c6e9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:26.311532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2a743-e30f-4505-9b11-16acb6de81a8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:26.311716 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02051b9f-40c5-4082-afb7-112c166c6e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:26.317857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02051b9f-40c5-4082-afb7-112c166c6e9c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:26.324538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 83/167] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:26.325441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051b9f-40c5-4082-afb7-112c166c6e9c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:26.417618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:26.423456 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:26.438099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2a743-e30f-4505-9b11-16acb6de81a8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:26.452053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02051b9f-40c5-4082-afb7-112c166c6e9c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:26.491134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90e57c-af83-4de2-8cdb-e526475f8939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:26.492685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90e57c-af83-4de2-8cdb-e526475f8939 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:26.493292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90e57c-af83-4de2-8cdb-e526475f8939 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:26.494546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b90e57c-af83-4de2-8cdb-e526475f8939 None admin] PATH_INFO: `/v3/users/9b72d80a668e4df2ad631da1eeae4189` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:26.496855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90e57c-af83-4de2-8cdb-e526475f8939 None admin] RBAC: Authorizing `identity:get_user(user_id=9b72d80a668e4df2ad631da1eeae4189)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:26.499638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b90e57c-af83-4de2-8cdb-e526475f8939 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:26.501720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 85/168] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:26 2022] GET /identity/v3/users/9b72d80a668e4df2ad631da1eeae4189 => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:26.503982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90e57c-af83-4de2-8cdb-e526475f8939 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:26.521227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc135c-b67d-4035-a2b5-4c391cf2bbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:26.522546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc135c-b67d-4035-a2b5-4c391cf2bbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:26.523029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc135c-b67d-4035-a2b5-4c391cf2bbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:26.523503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc135c-b67d-4035-a2b5-4c391cf2bbe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:26.524446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc135c-b67d-4035-a2b5-4c391cf2bbe2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:26.524927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc135c-b67d-4035-a2b5-4c391cf2bbe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:26.526496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc135c-b67d-4035-a2b5-4c391cf2bbe2 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:26.543222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 84/169] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:26.545658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc135c-b67d-4035-a2b5-4c391cf2bbe2 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:26.699559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b90e57c-af83-4de2-8cdb-e526475f8939 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:26.711312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc135c-b67d-4035-a2b5-4c391cf2bbe2 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:26.755750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f4c7b-4766-4a02-a6b8-ebe46d2ebfc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:26.756651 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f4c7b-4766-4a02-a6b8-ebe46d2ebfc9 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:26.756939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f4c7b-4766-4a02-a6b8-ebe46d2ebfc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:26.757220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93f4c7b-4766-4a02-a6b8-ebe46d2ebfc9 None admin] PATH_INFO: `/v3/users/f869ee38ef2a44d298334f947030268e` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:26.758520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f4c7b-4766-4a02-a6b8-ebe46d2ebfc9 None admin] RBAC: Authorizing `identity:get_user(user_id=f869ee38ef2a44d298334f947030268e)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:26.760034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93f4c7b-4766-4a02-a6b8-ebe46d2ebfc9 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:26.761702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 86/170] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:26 2022] GET /identity/v3/users/f869ee38ef2a44d298334f947030268e => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:26.762477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f4c7b-4766-4a02-a6b8-ebe46d2ebfc9 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:26.778236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48a48-f8ab-4db1-adc2-73e797990ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:26.779206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48a48-f8ab-4db1-adc2-73e797990ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:26.779770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48a48-f8ab-4db1-adc2-73e797990ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:26.780224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48a48-f8ab-4db1-adc2-73e797990ef8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:26.792172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:26.795055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:26.881208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b48a48-f8ab-4db1-adc2-73e797990ef8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:26.883008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b48a48-f8ab-4db1-adc2-73e797990ef8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:26.937131 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93f4c7b-4766-4a02-a6b8-ebe46d2ebfc9 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:27.044730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790e5bd-c4c5-40c8-8973-8084b2cf6894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:27.045548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790e5bd-c4c5-40c8-8973-8084b2cf6894 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.045832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790e5bd-c4c5-40c8-8973-8084b2cf6894 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.046108 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c790e5bd-c4c5-40c8-8973-8084b2cf6894 None admin] PATH_INFO: `/v3/users/f869ee38ef2a44d298334f947030268e` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.051777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790e5bd-c4c5-40c8-8973-8084b2cf6894 None admin] RBAC: Authorizing `identity:get_user(user_id=f869ee38ef2a44d298334f947030268e)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:27.053282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c790e5bd-c4c5-40c8-8973-8084b2cf6894 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:27.055018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 87/171] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:26 2022] GET /identity/v3/users/f869ee38ef2a44d298334f947030268e => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:27.055812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790e5bd-c4c5-40c8-8973-8084b2cf6894 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.068885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 85/172] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:27.074504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48a48-f8ab-4db1-adc2-73e797990ef8 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.146148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:27.265087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48a48-f8ab-4db1-adc2-73e797990ef8 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:27.338027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:27.360183 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4046f2-aa76-42c1-aacc-b448f42a49bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:27.360844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4046f2-aa76-42c1-aacc-b448f42a49bc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.361128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4046f2-aa76-42c1-aacc-b448f42a49bc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.361405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4046f2-aa76-42c1-aacc-b448f42a49bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.369549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c790e5bd-c4c5-40c8-8973-8084b2cf6894 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:27.464679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99ae1f-2efb-4911-90a7-05d22cb27f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:27.465352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ae1f-2efb-4911-90a7-05d22cb27f0d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.465639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ae1f-2efb-4911-90a7-05d22cb27f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.465920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c99ae1f-2efb-4911-90a7-05d22cb27f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.491236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4046f2-aa76-42c1-aacc-b448f42a49bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:27.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4046f2-aa76-42c1-aacc-b448f42a49bc None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:27.542046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:27.656102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99ae1f-2efb-4911-90a7-05d22cb27f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:27.657512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c99ae1f-2efb-4911-90a7-05d22cb27f0d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:27.663505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 86/173] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:27.664505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4046f2-aa76-42c1-aacc-b448f42a49bc None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.841875 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4046f2-aa76-42c1-aacc-b448f42a49bc None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:27.844928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:27.870265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 88/174] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 815 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:27.872739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99ae1f-2efb-4911-90a7-05d22cb27f0d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.967684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60887c7f-e863-415d-b4a5-14f142a0d607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:27.968566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60887c7f-e863-415d-b4a5-14f142a0d607 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:27.968848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60887c7f-e863-415d-b4a5-14f142a0d607 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:27.969191 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60887c7f-e863-415d-b4a5-14f142a0d607 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:27.970351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60887c7f-e863-415d-b4a5-14f142a0d607 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:27.974995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60887c7f-e863-415d-b4a5-14f142a0d607 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:27.974995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 87/175] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:27.975185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60887c7f-e863-415d-b4a5-14f142a0d607 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:27.998899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:28.046979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c99ae1f-2efb-4911-90a7-05d22cb27f0d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:28.104757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3646346-3771-44dd-9043-e5d4c5abc1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:28.105991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3646346-3771-44dd-9043-e5d4c5abc1ff None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:28.106475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3646346-3771-44dd-9043-e5d4c5abc1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:28.106971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3646346-3771-44dd-9043-e5d4c5abc1ff None admin] PATH_INFO: `/v3/projects/9ccbe5d4f51a43819452f5b2ee6d0a47` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:28.108467 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3646346-3771-44dd-9043-e5d4c5abc1ff None admin] RBAC: Authorizing `identity:get_project(project_id=9ccbe5d4f51a43819452f5b2ee6d0a47)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:28.110285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3646346-3771-44dd-9043-e5d4c5abc1ff None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:28.112245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 89/176] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/projects/9ccbe5d4f51a43819452f5b2ee6d0a47 => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:28.113775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3646346-3771-44dd-9043-e5d4c5abc1ff None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:28.221034 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60887c7f-e863-415d-b4a5-14f142a0d607 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:28.241412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:28.309409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3646346-3771-44dd-9043-e5d4c5abc1ff None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:28.332259 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a9de6-a798-4b69-b654-d4c082943c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:28.334091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a9de6-a798-4b69-b654-d4c082943c5e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:28.335767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a9de6-a798-4b69-b654-d4c082943c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:28.337262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a9de6-a798-4b69-b654-d4c082943c5e None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:28.341376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a9de6-a798-4b69-b654-d4c082943c5e None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:28.343103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a9de6-a798-4b69-b654-d4c082943c5e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:28.346588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 88/177] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:27 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:28.349585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a9de6-a798-4b69-b654-d4c082943c5e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:28.372649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c44c16-3a25-43e5-b8d5-8fd692ee5d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:28.373918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44c16-3a25-43e5-b8d5-8fd692ee5d55 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:28.375156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44c16-3a25-43e5-b8d5-8fd692ee5d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:28.375825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c44c16-3a25-43e5-b8d5-8fd692ee5d55 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:28.377722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c44c16-3a25-43e5-b8d5-8fd692ee5d55 None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=6a4c69c73a874668837daa9a9951b335, user.id=9b72d80a668e4df2ad631da1eeae4189) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:28.379362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c44c16-3a25-43e5-b8d5-8fd692ee5d55 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:28.383059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c44c16-3a25-43e5-b8d5-8fd692ee5d55 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:28.396285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 90/178] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:28 2022] GET /identity/v3/role_assignments?user.id=9b72d80a668e4df2ad631da1eeae4189&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:28.397861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bd6d6-a291-4b5a-b773-d89cc4c6f089 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:28.399735 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bd6d6-a291-4b5a-b773-d89cc4c6f089 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:28.400256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1bd6d6-a291-4b5a-b773-d89cc4c6f089 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:28.402005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 91/179] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:28.404298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bd6d6-a291-4b5a-b773-d89cc4c6f089 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:28.509205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:28.564032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a9de6-a798-4b69-b654-d4c082943c5e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:28.612484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1bd6d6-a291-4b5a-b773-d89cc4c6f089 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:28.627988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5a092-3253-479f-8caa-15ab5b55d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:28.629330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5a092-3253-479f-8caa-15ab5b55d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:28.629932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5a092-3253-479f-8caa-15ab5b55d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:28.630417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5a092-3253-479f-8caa-15ab5b55d7e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:28.631619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5a092-3253-479f-8caa-15ab5b55d7e8 None admin] RBAC: Adding query filter params (role.id=49806c1799404d039cb4e2a11f1d4442, scope.project.id=9ccbe5d4f51a43819452f5b2ee6d0a47, user.id=f869ee38ef2a44d298334f947030268e) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:28.634975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5a092-3253-479f-8caa-15ab5b55d7e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:28.636794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5a092-3253-479f-8caa-15ab5b55d7e8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:28.650251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 89/180] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:28 2022] GET /identity/v3/role_assignments?user.id=f869ee38ef2a44d298334f947030268e&scope.project.id=9ccbe5d4f51a43819452f5b2ee6d0a47&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 608 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:28.654330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442a709-eba5-423b-9687-fe1500abfda9 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:28.654890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442a709-eba5-423b-9687-fe1500abfda9 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:28.655701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442a709-eba5-423b-9687-fe1500abfda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:28.671313 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:28.685757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7442a709-eba5-423b-9687-fe1500abfda9 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:28.687409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7442a709-eba5-423b-9687-fe1500abfda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:28.711324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863486a-a255-4041-b376-34bc80ec79c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:28.712261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863486a-a255-4041-b376-34bc80ec79c4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:28.712554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863486a-a255-4041-b376-34bc80ec79c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:28.712952 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863486a-a255-4041-b376-34bc80ec79c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:28.713822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863486a-a255-4041-b376-34bc80ec79c4 None admin] RBAC: Adding query filter params (role.id=b29b8d5f31b44d8b90eb10c34acbc06a, scope.project.id=6a4c69c73a874668837daa9a9951b335, user.id=f869ee38ef2a44d298334f947030268e) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:28.714256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863486a-a255-4041-b376-34bc80ec79c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:28.715815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863486a-a255-4041-b376-34bc80ec79c4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:28.726909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 92/181] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:28 2022] GET /identity/v3/role_assignments?user.id=f869ee38ef2a44d298334f947030268e&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=b29b8d5f31b44d8b90eb10c34acbc06a => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:28.732805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7f074-cc56-4cc6-8142-e80646bf3f25 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:28.733245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7f074-cc56-4cc6-8142-e80646bf3f25 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:28.733677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb7f074-cc56-4cc6-8142-e80646bf3f25 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:28.735571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 93/182] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:28.741789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fc870-513f-4bfa-8c94-ae7d6b26491d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:28.742425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fc870-513f-4bfa-8c94-ae7d6b26491d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:28.742904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19fc870-513f-4bfa-8c94-ae7d6b26491d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:28.785041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c19fc870-513f-4bfa-8c94-ae7d6b26491d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:28.787234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c19fc870-513f-4bfa-8c94-ae7d6b26491d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:28.806171 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 90/183] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:28.839916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442a709-eba5-423b-9687-fe1500abfda9 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:28.929527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 94/184] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:28.960259 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:28.972884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fc870-513f-4bfa-8c94-ae7d6b26491d None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:29.003322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442a709-eba5-423b-9687-fe1500abfda9 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:29.048315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cb252-a1c7-4857-8db4-0724c0efc935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:29.049510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cb252-a1c7-4857-8db4-0724c0efc935 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.050887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cb252-a1c7-4857-8db4-0724c0efc935 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.051397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72cb252-a1c7-4857-8db4-0724c0efc935 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.069328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72cb252-a1c7-4857-8db4-0724c0efc935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-c72cb252-a1c7-4857-8db4-0724c0efc935 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:29.079550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:29.080659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:29.081652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:29.085476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 91/185] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:29.091703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cb252-a1c7-4857-8db4-0724c0efc935 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:29.120497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19fc870-513f-4bfa-8c94-ae7d6b26491d None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:29.138464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:29.158355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ea398-703a-4f5f-839a-98eaad9622ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:29.159357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ea398-703a-4f5f-839a-98eaad9622ad None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.160453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ea398-703a-4f5f-839a-98eaad9622ad None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.160804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ea398-703a-4f5f-839a-98eaad9622ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.173928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ea398-703a-4f5f-839a-98eaad9622ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-137ea398-703a-4f5f-839a-98eaad9622ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:29.182468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:29.183492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:29.184293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:29.186840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 95/186] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:29.200271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ea398-703a-4f5f-839a-98eaad9622ad None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:29.223094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72cb252-a1c7-4857-8db4-0724c0efc935 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:29.254092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:29.262928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b619bf75-7465-4e2a-a555-faddda9f7680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:29.263619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619bf75-7465-4e2a-a555-faddda9f7680 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.263903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619bf75-7465-4e2a-a555-faddda9f7680 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.264182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b619bf75-7465-4e2a-a555-faddda9f7680 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.264932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619bf75-7465-4e2a-a555-faddda9f7680 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:29.265244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619bf75-7465-4e2a-a555-faddda9f7680 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:29.266643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b619bf75-7465-4e2a-a555-faddda9f7680 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:29.276115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 92/187] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:29.277357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d297e4-1af1-4cb4-a39d-2185d5a21c41 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.277647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d297e4-1af1-4cb4-a39d-2185d5a21c41 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.277919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d297e4-1af1-4cb4-a39d-2185d5a21c41 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.280662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 93/188] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:29.282222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d297e4-1af1-4cb4-a39d-2185d5a21c41 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:29.323810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ea398-703a-4f5f-839a-98eaad9622ad None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:29.357806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6e708e-9bde-48af-868e-1c8fa48b3d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:29.358469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e708e-9bde-48af-868e-1c8fa48b3d1c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.358746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e708e-9bde-48af-868e-1c8fa48b3d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.359051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6e708e-9bde-48af-868e-1c8fa48b3d1c None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.359794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e708e-9bde-48af-868e-1c8fa48b3d1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:29.360124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e708e-9bde-48af-868e-1c8fa48b3d1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:29.361494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6e708e-9bde-48af-868e-1c8fa48b3d1c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:29.370155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 96/189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:29.371473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c761f-15f9-47b0-be59-f0dcf6443831 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.371764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c761f-15f9-47b0-be59-f0dcf6443831 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.372039 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34c761f-15f9-47b0-be59-f0dcf6443831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.389698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c34c761f-15f9-47b0-be59-f0dcf6443831 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:29.390886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c34c761f-15f9-47b0-be59-f0dcf6443831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:29.403501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d297e4-1af1-4cb4-a39d-2185d5a21c41 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:29.422302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:29.442242 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eeff6-2c17-44a5-80fa-2cca269d7cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:29.443166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eeff6-2c17-44a5-80fa-2cca269d7cfa None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.443446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eeff6-2c17-44a5-80fa-2cca269d7cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.443727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6eeff6-2c17-44a5-80fa-2cca269d7cfa None admin] PATH_INFO: `/v3/users/50163bec976647dfb62081328a6725cd` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.444914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6eeff6-2c17-44a5-80fa-2cca269d7cfa None admin] RBAC: Authorizing `identity:get_user(user_id=50163bec976647dfb62081328a6725cd)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:29.446429 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6eeff6-2c17-44a5-80fa-2cca269d7cfa None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:29.452502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 94/190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:29 2022] GET /identity/v3/users/50163bec976647dfb62081328a6725cd => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:29.452502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eeff6-2c17-44a5-80fa-2cca269d7cfa None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:29.467562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 97/191] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:29.475123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c761f-15f9-47b0-be59-f0dcf6443831 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:29.523395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:29.565096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6eeff6-2c17-44a5-80fa-2cca269d7cfa None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:29.574412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34c761f-15f9-47b0-be59-f0dcf6443831 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:29.603077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1ffd9-549c-4e35-ba0d-0c5b0d4deaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:29.604533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1ffd9-549c-4e35-ba0d-0c5b0d4deaab None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.604862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1ffd9-549c-4e35-ba0d-0c5b0d4deaab None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.605142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1ffd9-549c-4e35-ba0d-0c5b0d4deaab None admin] PATH_INFO: `/v3/users/18f5a8140eae41bb919f068bb3fc8f23` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.610330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816442c-4317-4b86-ac6d-d3e7c5d5e053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:29.610999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816442c-4317-4b86-ac6d-d3e7c5d5e053 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.611283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816442c-4317-4b86-ac6d-d3e7c5d5e053 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.611557 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816442c-4317-4b86-ac6d-d3e7c5d5e053 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.619214 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1ffd9-549c-4e35-ba0d-0c5b0d4deaab None admin] RBAC: Authorizing `identity:get_user(user_id=18f5a8140eae41bb919f068bb3fc8f23)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:29.620702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1ffd9-549c-4e35-ba0d-0c5b0d4deaab None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:29.622399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 95/192] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:29 2022] GET /identity/v3/users/18f5a8140eae41bb919f068bb3fc8f23 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:29.624272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acaca8-f3d1-49fb-be6d-0c62a12f534e None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.624720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acaca8-f3d1-49fb-be6d-0c62a12f534e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.625000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10acaca8-f3d1-49fb-be6d-0c62a12f534e None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.627005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 96/193] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:29.627005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acaca8-f3d1-49fb-be6d-0c62a12f534e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:29.647256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:29.679745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816442c-4317-4b86-ac6d-d3e7c5d5e053 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:29.681249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816442c-4317-4b86-ac6d-d3e7c5d5e053 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:29.732789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10acaca8-f3d1-49fb-be6d-0c62a12f534e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:29.749292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:29.767554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfc092-b69a-46a7-a848-c852ecf17588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:29.768348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc092-b69a-46a7-a848-c852ecf17588 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.768633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc092-b69a-46a7-a848-c852ecf17588 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.768903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfc092-b69a-46a7-a848-c852ecf17588 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.778744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfc092-b69a-46a7-a848-c852ecf17588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:29.780825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 98/194] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:29.781670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816442c-4317-4b86-ac6d-d3e7c5d5e053 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-4cdfc092-b69a-46a7-a848-c852ecf17588 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:29.787117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:29.788170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 97/195] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:29.793776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7820ef-d1f5-4d66-ae8f-e38ebd702a29 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.794483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7820ef-d1f5-4d66-ae8f-e38ebd702a29 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.794483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7820ef-d1f5-4d66-ae8f-e38ebd702a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.807102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-be7820ef-d1f5-4d66-ae8f-e38ebd702a29 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:29.808280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-be7820ef-d1f5-4d66-ae8f-e38ebd702a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:29.849365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:29.875878 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 98/196] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:29.876840 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7820ef-d1f5-4d66-ae8f-e38ebd702a29 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:29.883846 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816442c-4317-4b86-ac6d-d3e7c5d5e053 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:29.920416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b487af-102b-4a5b-a66b-2031df0eda7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:29.921110 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b487af-102b-4a5b-a66b-2031df0eda7e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:29.921395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b487af-102b-4a5b-a66b-2031df0eda7e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:29.921673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b487af-102b-4a5b-a66b-2031df0eda7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:29.981973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7820ef-d1f5-4d66-ae8f-e38ebd702a29 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:29.989877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:29.996919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b487af-102b-4a5b-a66b-2031df0eda7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:29.998396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b487af-102b-4a5b-a66b-2031df0eda7e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.016509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d454aa-ccc3-41a5-8e8d-93701e2c81fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.017365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d454aa-ccc3-41a5-8e8d-93701e2c81fd None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.017643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d454aa-ccc3-41a5-8e8d-93701e2c81fd None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.017921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d454aa-ccc3-41a5-8e8d-93701e2c81fd None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.019705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d454aa-ccc3-41a5-8e8d-93701e2c81fd None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.021195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d454aa-ccc3-41a5-8e8d-93701e2c81fd None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.022889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 99/197] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:29 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:30.027872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d454aa-ccc3-41a5-8e8d-93701e2c81fd None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:30.062762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:30.098064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 99/198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:30.098891 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b487af-102b-4a5b-a66b-2031df0eda7e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:30.121827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d454aa-ccc3-41a5-8e8d-93701e2c81fd None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:30.155546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e12f5-a810-4edc-a4b5-6f5e63b4d059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.156186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e12f5-a810-4edc-a4b5-6f5e63b4d059 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.156464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e12f5-a810-4edc-a4b5-6f5e63b4d059 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.156738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e12f5-a810-4edc-a4b5-6f5e63b4d059 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.157478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e12f5-a810-4edc-a4b5-6f5e63b4d059 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:30.157786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e12f5-a810-4edc-a4b5-6f5e63b4d059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.159200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e12f5-a810-4edc-a4b5-6f5e63b4d059 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.167204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 100/199] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:30.167204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e12f5-a810-4edc-a4b5-6f5e63b4d059 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:30.198843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b487af-102b-4a5b-a66b-2031df0eda7e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:30.203944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:30.233794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7ce18-b025-42f4-93b1-17c43e65977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.234586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7ce18-b025-42f4-93b1-17c43e65977d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.234864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7ce18-b025-42f4-93b1-17c43e65977d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.235174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d7ce18-b025-42f4-93b1-17c43e65977d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.236334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7ce18-b025-42f4-93b1-17c43e65977d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.237783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d7ce18-b025-42f4-93b1-17c43e65977d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.240209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 100/200] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:30.240965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7ce18-b025-42f4-93b1-17c43e65977d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:30.278049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:30.279691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e12f5-a810-4edc-a4b5-6f5e63b4d059 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:30.313222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22de56d-64b1-44e8-af4c-0226a895089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.314260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22de56d-64b1-44e8-af4c-0226a895089b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.314550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22de56d-64b1-44e8-af4c-0226a895089b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.314832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22de56d-64b1-44e8-af4c-0226a895089b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.315713 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22de56d-64b1-44e8-af4c-0226a895089b None admin] RBAC: Adding query filter params (role.id=7103b531aa6246d7b44730f73395761f, scope.project.id=6a4c69c73a874668837daa9a9951b335, user.id=50163bec976647dfb62081328a6725cd) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:30.316036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22de56d-64b1-44e8-af4c-0226a895089b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.318343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22de56d-64b1-44e8-af4c-0226a895089b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.325385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 101/201] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:30 2022] GET /identity/v3/role_assignments?user.id=50163bec976647dfb62081328a6725cd&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=7103b531aa6246d7b44730f73395761f => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:30.327849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22de56d-64b1-44e8-af4c-0226a895089b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:30.348952 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d7ce18-b025-42f4-93b1-17c43e65977d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:30.389644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7e89f-d240-41e8-9c6f-547cacdded99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.390434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7e89f-d240-41e8-9c6f-547cacdded99 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.390712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7e89f-d240-41e8-9c6f-547cacdded99 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.391007 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b7e89f-d240-41e8-9c6f-547cacdded99 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.392298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7e89f-d240-41e8-9c6f-547cacdded99 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.393804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b7e89f-d240-41e8-9c6f-547cacdded99 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.400999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 101/202] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:30 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:30.400999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7e89f-d240-41e8-9c6f-547cacdded99 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:30.450251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:30.453607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22de56d-64b1-44e8-af4c-0226a895089b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:30.496391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026bc11-b407-47d1-ba74-d3029803e7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.497270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026bc11-b407-47d1-ba74-d3029803e7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.497555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026bc11-b407-47d1-ba74-d3029803e7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.497836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026bc11-b407-47d1-ba74-d3029803e7f9 None admin] PATH_INFO: `/v3/users/18f5a8140eae41bb919f068bb3fc8f23` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.499728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026bc11-b407-47d1-ba74-d3029803e7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=18f5a8140eae41bb919f068bb3fc8f23)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.501206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026bc11-b407-47d1-ba74-d3029803e7f9 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.503051 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 102/203] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:30 2022] GET /identity/v3/users/18f5a8140eae41bb919f068bb3fc8f23 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:30.507832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026bc11-b407-47d1-ba74-d3029803e7f9 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:30.526204 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b7e89f-d240-41e8-9c6f-547cacdded99 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:30.529811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:30.568998 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597637a-a539-42a2-a79d-085d30856b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.569813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597637a-a539-42a2-a79d-085d30856b94 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.570099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597637a-a539-42a2-a79d-085d30856b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.570382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597637a-a539-42a2-a79d-085d30856b94 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.571292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597637a-a539-42a2-a79d-085d30856b94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.573207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597637a-a539-42a2-a79d-085d30856b94 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.593411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 102/204] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:30 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:30.595909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597637a-a539-42a2-a79d-085d30856b94 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:30.621692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026bc11-b407-47d1-ba74-d3029803e7f9 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:30.662481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3def66a-777d-4685-b41f-a68f19adb93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.663090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3def66a-777d-4685-b41f-a68f19adb93e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.663376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3def66a-777d-4685-b41f-a68f19adb93e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.663667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3def66a-777d-4685-b41f-a68f19adb93e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.664502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3def66a-777d-4685-b41f-a68f19adb93e None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=91700d043c204f948188f50578e3abdc, user.id=18f5a8140eae41bb919f068bb3fc8f23) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:30.664864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3def66a-777d-4685-b41f-a68f19adb93e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.666361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3def66a-777d-4685-b41f-a68f19adb93e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.674376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 103/205] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:30 2022] GET /identity/v3/role_assignments?user.id=18f5a8140eae41bb919f068bb3fc8f23&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:30.719240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597637a-a539-42a2-a79d-085d30856b94 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:30.765938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c89b1-3a38-40a0-a524-988d353ac59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:30.766614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c89b1-3a38-40a0-a524-988d353ac59f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:30.766905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c89b1-3a38-40a0-a524-988d353ac59f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:30.767248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c89b1-3a38-40a0-a524-988d353ac59f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:30.802596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:30.855106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c89b1-3a38-40a0-a524-988d353ac59f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:30.856502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c89b1-3a38-40a0-a524-988d353ac59f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:30.967687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 103/206] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:30.973349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3def66a-777d-4685-b41f-a68f19adb93e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:31.006371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:31.081641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3def66a-777d-4685-b41f-a68f19adb93e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:31.119688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2009546-45e6-4eb7-8779-67e4ebcd6be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:31.120567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2009546-45e6-4eb7-8779-67e4ebcd6be7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:31.120853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2009546-45e6-4eb7-8779-67e4ebcd6be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:31.121132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2009546-45e6-4eb7-8779-67e4ebcd6be7 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:31.122347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2009546-45e6-4eb7-8779-67e4ebcd6be7 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:31.123862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2009546-45e6-4eb7-8779-67e4ebcd6be7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:31.125591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 104/207] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:30 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:31.131567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c89b1-3a38-40a0-a524-988d353ac59f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:31.204684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:31.237137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c89b1-3a38-40a0-a524-988d353ac59f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:31.275493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726dc964-5f6d-4100-9dcb-19943703228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:31.276161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc964-5f6d-4100-9dcb-19943703228c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:31.276448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc964-5f6d-4100-9dcb-19943703228c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:31.276730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726dc964-5f6d-4100-9dcb-19943703228c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:31.277573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dc964-5f6d-4100-9dcb-19943703228c None admin] RBAC: Adding query filter params (role.id=b29b8d5f31b44d8b90eb10c34acbc06a, scope.project.id=91700d043c204f948188f50578e3abdc, user.id=18f5a8140eae41bb919f068bb3fc8f23) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:31.279305 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dc964-5f6d-4100-9dcb-19943703228c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:31.280803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726dc964-5f6d-4100-9dcb-19943703228c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:31.287720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 104/208] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:31 2022] GET /identity/v3/role_assignments?user.id=18f5a8140eae41bb919f068bb3fc8f23&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=b29b8d5f31b44d8b90eb10c34acbc06a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:32.732147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffb5d0-5f85-4fa3-be3f-696dbe64e4d3 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:32.733037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffb5d0-5f85-4fa3-be3f-696dbe64e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:32.733468 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ffb5d0-5f85-4fa3-be3f-696dbe64e4d3 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:32.735289 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 105/209] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:32.743461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4370e2f-fae4-40de-bef5-1d57d74b126e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:32.744326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4370e2f-fae4-40de-bef5-1d57d74b126e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:32.744812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4370e2f-fae4-40de-bef5-1d57d74b126e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:32.762085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b4370e2f-fae4-40de-bef5-1d57d74b126e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:32.763597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b4370e2f-fae4-40de-bef5-1d57d74b126e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:32.835097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046611e-f0a8-4cd9-8e22-db21fcfd98a0 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:32.835765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046611e-f0a8-4cd9-8e22-db21fcfd98a0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:32.836275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f046611e-f0a8-4cd9-8e22-db21fcfd98a0 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:32.837153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 105/210] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:32.838345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 106/211] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:32.843617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f067917-e38c-4c44-8d61-f09437822be3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:32.843911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f067917-e38c-4c44-8d61-f09437822be3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:32.844191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f067917-e38c-4c44-8d61-f09437822be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:32.862541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-9f067917-e38c-4c44-8d61-f09437822be3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:32.863603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046611e-f0a8-4cd9-8e22-db21fcfd98a0 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:32.864121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9f067917-e38c-4c44-8d61-f09437822be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:32.915041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:32.935523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 106/212] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:32.940403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da7b53-b760-41da-b45a-07f2f80bca9d None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:32.940891 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da7b53-b760-41da-b45a-07f2f80bca9d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:32.941953 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da7b53-b760-41da-b45a-07f2f80bca9d None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:32.943859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 107/213] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:32.951986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224b20-ca74-4f20-b3dd-de677b8cf14b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:32.952278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224b20-ca74-4f20-b3dd-de677b8cf14b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:32.952560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa224b20-ca74-4f20-b3dd-de677b8cf14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:32.971084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fa224b20-ca74-4f20-b3dd-de677b8cf14b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:32.972883 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fa224b20-ca74-4f20-b3dd-de677b8cf14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:32.978925 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:32.984287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f046611e-f0a8-4cd9-8e22-db21fcfd98a0 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.024433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcbd79-e2e2-4b1a-83eb-ee78835196bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.025232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbd79-e2e2-4b1a-83eb-ee78835196bc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.025735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbd79-e2e2-4b1a-83eb-ee78835196bc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.025842 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcbd79-e2e2-4b1a-83eb-ee78835196bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.037544 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcbd79-e2e2-4b1a-83eb-ee78835196bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-afbcbd79-e2e2-4b1a-83eb-ee78835196bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:33.045278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:33.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:33.047375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:33.051424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 107/214] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:33.052299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcbd79-e2e2-4b1a-83eb-ee78835196bc None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.055109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 108/215] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:33.057006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa224b20-ca74-4f20-b3dd-de677b8cf14b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.158426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa224b20-ca74-4f20-b3dd-de677b8cf14b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.163204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcbd79-e2e2-4b1a-83eb-ee78835196bc None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.173358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:33.198590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb84f8-0125-4c5a-812e-619207c03a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.199388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb84f8-0125-4c5a-812e-619207c03a17 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.199675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb84f8-0125-4c5a-812e-619207c03a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.199956 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb84f8-0125-4c5a-812e-619207c03a17 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.200716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb84f8-0125-4c5a-812e-619207c03a17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:33.201027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb84f8-0125-4c5a-812e-619207c03a17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:33.204582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb84f8-0125-4c5a-812e-619207c03a17 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:33.204712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f063d-ad34-46f6-8c55-fe967625d620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.204712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f063d-ad34-46f6-8c55-fe967625d620 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.205028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f063d-ad34-46f6-8c55-fe967625d620 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.205311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f063d-ad34-46f6-8c55-fe967625d620 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.214018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 109/216] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:33.217688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb84f8-0125-4c5a-812e-619207c03a17 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.219173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f063d-ad34-46f6-8c55-fe967625d620 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-ff7f063d-ad34-46f6-8c55-fe967625d620 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:33.229112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:33.230106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:33.230890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 108/217] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:33.231600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f063d-ad34-46f6-8c55-fe967625d620 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.256537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:33.336098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb84f8-0125-4c5a-812e-619207c03a17 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.339962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f063d-ad34-46f6-8c55-fe967625d620 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.377314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10987642-eb2b-45d0-9d52-e3723c9b585e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.378110 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987642-eb2b-45d0-9d52-e3723c9b585e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.378389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987642-eb2b-45d0-9d52-e3723c9b585e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.378549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92189b8d-5610-43dc-ad70-055126053b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.378702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10987642-eb2b-45d0-9d52-e3723c9b585e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.379535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92189b8d-5610-43dc-ad70-055126053b75 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.379827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92189b8d-5610-43dc-ad70-055126053b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.379975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10987642-eb2b-45d0-9d52-e3723c9b585e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:33.380104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92189b8d-5610-43dc-ad70-055126053b75 None admin] PATH_INFO: `/v3/users/18f5a8140eae41bb919f068bb3fc8f23` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.381318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92189b8d-5610-43dc-ad70-055126053b75 None admin] RBAC: Authorizing `identity:get_user(user_id=18f5a8140eae41bb919f068bb3fc8f23)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:33.381425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10987642-eb2b-45d0-9d52-e3723c9b585e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:33.382766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92189b8d-5610-43dc-ad70-055126053b75 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:33.383063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 110/218] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:33.383824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10987642-eb2b-45d0-9d52-e3723c9b585e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.384566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 109/219] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/users/18f5a8140eae41bb919f068bb3fc8f23 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:33.385576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51012645-22c3-4fc8-aff0-86d1a7e64a02 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.385860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51012645-22c3-4fc8-aff0-86d1a7e64a02 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.386134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51012645-22c3-4fc8-aff0-86d1a7e64a02 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.387716 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 110/220] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:33.388517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51012645-22c3-4fc8-aff0-86d1a7e64a02 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.433768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:33.477024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:33.487348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10987642-eb2b-45d0-9d52-e3723c9b585e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.490590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51012645-22c3-4fc8-aff0-86d1a7e64a02 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.520990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f00e62-7796-498f-86b5-376a1f1d7653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.521579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00e62-7796-498f-86b5-376a1f1d7653 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.521885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00e62-7796-498f-86b5-376a1f1d7653 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.522156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f00e62-7796-498f-86b5-376a1f1d7653 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.522900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f00e62-7796-498f-86b5-376a1f1d7653 None admin] RBAC: Adding query filter params (name=member) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:33.523228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f00e62-7796-498f-86b5-376a1f1d7653 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:33.523428 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d2d491-4af4-4ae3-b8ed-a954c058b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.524084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2d491-4af4-4ae3-b8ed-a954c058b336 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.524365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2d491-4af4-4ae3-b8ed-a954c058b336 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.524634 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f00e62-7796-498f-86b5-376a1f1d7653 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:33.524722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d2d491-4af4-4ae3-b8ed-a954c058b336 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.525336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2d491-4af4-4ae3-b8ed-a954c058b336 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:33.526766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d2d491-4af4-4ae3-b8ed-a954c058b336 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:33.532580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 111/221] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:33.532580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f00e62-7796-498f-86b5-376a1f1d7653 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.548085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 111/222] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:33 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:04:33.556626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d58e4-5475-4652-8e17-c9dd92de7e64 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.556966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d58e4-5475-4652-8e17-c9dd92de7e64 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.557252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d58e4-5475-4652-8e17-c9dd92de7e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.574915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-f48d58e4-5475-4652-8e17-c9dd92de7e64 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:33.576170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f48d58e4-5475-4652-8e17-c9dd92de7e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:33.648842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f00e62-7796-498f-86b5-376a1f1d7653 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.652712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 112/223] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:33.663492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:33.664747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d58e4-5475-4652-8e17-c9dd92de7e64 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.692463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f784b4-8763-430d-965c-6ee58434cc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.693348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f784b4-8763-430d-965c-6ee58434cc08 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.693637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f784b4-8763-430d-965c-6ee58434cc08 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.693917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f784b4-8763-430d-965c-6ee58434cc08 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.695170 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f784b4-8763-430d-965c-6ee58434cc08 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:33.696657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f784b4-8763-430d-965c-6ee58434cc08 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:33.699122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 112/224] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:33.699236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f784b4-8763-430d-965c-6ee58434cc08 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.751344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:33.786501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d58e4-5475-4652-8e17-c9dd92de7e64 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.819041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f784b4-8763-430d-965c-6ee58434cc08 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:33.829026 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b90ead-aed3-4a51-8add-4dca0663d8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.830457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b90ead-aed3-4a51-8add-4dca0663d8ce None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.830737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b90ead-aed3-4a51-8add-4dca0663d8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.831117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b90ead-aed3-4a51-8add-4dca0663d8ce None admin] PATH_INFO: `/v3/users/5f806d31bac74e278919e56134f393f9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.850290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b90ead-aed3-4a51-8add-4dca0663d8ce None admin] RBAC: Authorizing `identity:get_user(user_id=5f806d31bac74e278919e56134f393f9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:33.852344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b90ead-aed3-4a51-8add-4dca0663d8ce None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:33.854691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 113/225] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/users/5f806d31bac74e278919e56134f393f9 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:33.855821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b90ead-aed3-4a51-8add-4dca0663d8ce None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.862566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162035-9d03-4522-9c1b-93d54fae2104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:33.864831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162035-9d03-4522-9c1b-93d54fae2104 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:33.865428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162035-9d03-4522-9c1b-93d54fae2104 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:33.865708 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5162035-9d03-4522-9c1b-93d54fae2104 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:33.878678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5162035-9d03-4522-9c1b-93d54fae2104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-d5162035-9d03-4522-9c1b-93d54fae2104 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:33.887221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:33.888096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:33.888894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 113/226] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:33.889548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162035-9d03-4522-9c1b-93d54fae2104 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:33.927324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:33.980846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b90ead-aed3-4a51-8add-4dca0663d8ce None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.013359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5162035-9d03-4522-9c1b-93d54fae2104 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.013914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.020176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec95d3-a358-4c62-adb8-29ce860b4205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.021222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec95d3-a358-4c62-adb8-29ce860b4205 None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.021684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec95d3-a358-4c62-adb8-29ce860b4205 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.022059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec95d3-a358-4c62-adb8-29ce860b4205 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc/users/18f5a8140eae41bb919f068bb3fc8f23/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.024229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec95d3-a358-4c62-adb8-29ce860b4205 None admin] RBAC: Authorizing `identity:create_grant(project_id=91700d043c204f948188f50578e3abdc, user_id=18f5a8140eae41bb919f068bb3fc8f23, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.025796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec95d3-a358-4c62-adb8-29ce860b4205 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.045138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 114/227] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:33 2022] PUT /identity/v3/projects/91700d043c204f948188f50578e3abdc/users/18f5a8140eae41bb919f068bb3fc8f23/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:34.046035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec95d3-a358-4c62-adb8-29ce860b4205 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.083713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a72f-5ac4-48de-bead-b3c96ad8108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.084791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a72f-5ac4-48de-bead-b3c96ad8108d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.085080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a72f-5ac4-48de-bead-b3c96ad8108d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.085363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534a72f-5ac4-48de-bead-b3c96ad8108d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.196293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec95d3-a358-4c62-adb8-29ce860b4205 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.233410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a72f-5ac4-48de-bead-b3c96ad8108d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.235305 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534a72f-5ac4-48de-bead-b3c96ad8108d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.268426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c7073-5690-438e-b327-f5137abc1b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.269910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c7073-5690-438e-b327-f5137abc1b8c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.270386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c7073-5690-438e-b327-f5137abc1b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.270666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8c7073-5690-438e-b327-f5137abc1b8c None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.271542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c7073-5690-438e-b327-f5137abc1b8c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:34.271852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c7073-5690-438e-b327-f5137abc1b8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.273989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8c7073-5690-438e-b327-f5137abc1b8c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.283072 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.293238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 115/228] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:34.299161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c7073-5690-438e-b327-f5137abc1b8c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.371691 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 114/229] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:34.373927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.377596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a72f-5ac4-48de-bead-b3c96ad8108d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.461180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8c7073-5690-438e-b327-f5137abc1b8c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.533506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba664ad-f4ea-4bad-9950-414e37dbf537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.534388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba664ad-f4ea-4bad-9950-414e37dbf537 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.534668 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba664ad-f4ea-4bad-9950-414e37dbf537 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.535529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba664ad-f4ea-4bad-9950-414e37dbf537 None admin] PATH_INFO: `/v3/users/18f5a8140eae41bb919f068bb3fc8f23` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.538404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba664ad-f4ea-4bad-9950-414e37dbf537 None admin] RBAC: Authorizing `identity:get_user(user_id=18f5a8140eae41bb919f068bb3fc8f23)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.541064 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba664ad-f4ea-4bad-9950-414e37dbf537 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.542725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 116/230] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/users/18f5a8140eae41bb919f068bb3fc8f23 => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:34.564486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba664ad-f4ea-4bad-9950-414e37dbf537 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.575054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534a72f-5ac4-48de-bead-b3c96ad8108d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.613806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a9ad-fb30-43be-8592-b1bbcbd1a732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.614756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a9ad-fb30-43be-8592-b1bbcbd1a732 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.615081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a9ad-fb30-43be-8592-b1bbcbd1a732 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.615359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9a9ad-fb30-43be-8592-b1bbcbd1a732 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.616683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9a9ad-fb30-43be-8592-b1bbcbd1a732 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.618333 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9a9ad-fb30-43be-8592-b1bbcbd1a732 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.620423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 115/231] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:34.625980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a9ad-fb30-43be-8592-b1bbcbd1a732 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.629321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.746203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9a9ad-fb30-43be-8592-b1bbcbd1a732 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.793099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4be69-436b-45c4-9c95-6d12e3b2c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.793841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4be69-436b-45c4-9c95-6d12e3b2c301 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.794042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4be69-436b-45c4-9c95-6d12e3b2c301 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.794319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4be69-436b-45c4-9c95-6d12e3b2c301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.795191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4be69-436b-45c4-9c95-6d12e3b2c301 None admin] RBAC: Adding query filter params (role.id=49806c1799404d039cb4e2a11f1d4442, scope.project.id=91700d043c204f948188f50578e3abdc, user.id=5f806d31bac74e278919e56134f393f9) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:34.795502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4be69-436b-45c4-9c95-6d12e3b2c301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.797153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4be69-436b-45c4-9c95-6d12e3b2c301 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.802978 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba664ad-f4ea-4bad-9950-414e37dbf537 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:34.809190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 116/232] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/role_assignments?user.id=5f806d31bac74e278919e56134f393f9&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:34.828870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:34.845376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658b7db-3310-4708-a44c-7de66c3745e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:34.846555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658b7db-3310-4708-a44c-7de66c3745e4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:34.847945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658b7db-3310-4708-a44c-7de66c3745e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:34.848748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658b7db-3310-4708-a44c-7de66c3745e4 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:34.850396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658b7db-3310-4708-a44c-7de66c3745e4 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:34.852147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658b7db-3310-4708-a44c-7de66c3745e4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:34.854269 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 117/233] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:34 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:34.863666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4be69-436b-45c4-9c95-6d12e3b2c301 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:34.999616 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:35.041910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4be69-436b-45c4-9c95-6d12e3b2c301 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:35.084905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8c592a-e748-4847-947a-2f4a55075afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:35.085730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c592a-e748-4847-947a-2f4a55075afa None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:35.086017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c592a-e748-4847-947a-2f4a55075afa None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:35.086291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8c592a-e748-4847-947a-2f4a55075afa None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc/users/18f5a8140eae41bb919f068bb3fc8f23/roles/b29b8d5f31b44d8b90eb10c34acbc06a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:35.088961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c592a-e748-4847-947a-2f4a55075afa None admin] RBAC: Authorizing `identity:create_grant(project_id=91700d043c204f948188f50578e3abdc, user_id=18f5a8140eae41bb919f068bb3fc8f23, role_id=b29b8d5f31b44d8b90eb10c34acbc06a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:35.090452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8c592a-e748-4847-947a-2f4a55075afa None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:35.112640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 117/234] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:34 2022] PUT /identity/v3/projects/91700d043c204f948188f50578e3abdc/users/18f5a8140eae41bb919f068bb3fc8f23/roles/b29b8d5f31b44d8b90eb10c34acbc06a => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:36.116793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e768-e5ae-4251-8e30-d43133b0e02e None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.117340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e768-e5ae-4251-8e30-d43133b0e02e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.117340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1671e768-e5ae-4251-8e30-d43133b0e02e None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.119026 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 118/235] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:36.128092 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420e1e7-87d6-4bdf-a667-fee7944f0039 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.128547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420e1e7-87d6-4bdf-a667-fee7944f0039 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.128645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5420e1e7-87d6-4bdf-a667-fee7944f0039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.156230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095277d-e1d3-4759-a6f8-07f2662036fd None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.156536 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095277d-e1d3-4759-a6f8-07f2662036fd None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.156798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095277d-e1d3-4759-a6f8-07f2662036fd None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.158625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 119/236] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:36.167853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-5420e1e7-87d6-4bdf-a667-fee7944f0039 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:36.167853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-5420e1e7-87d6-4bdf-a667-fee7944f0039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:36.171739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12847ea-58f4-494a-a571-668bbce57c3f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.172227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12847ea-58f4-494a-a571-668bbce57c3f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.172514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12847ea-58f4-494a-a571-668bbce57c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.198895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-b12847ea-58f4-494a-a571-668bbce57c3f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:36.201199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b12847ea-58f4-494a-a571-668bbce57c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:36.300709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 120/237] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:36.302625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 118/238] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:36.331316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12847ea-58f4-494a-a571-668bbce57c3f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:36.342664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420e1e7-87d6-4bdf-a667-fee7944f0039 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:36.478320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:36.479639 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12847ea-58f4-494a-a571-668bbce57c3f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:36.511530 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:36.527395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63980d7-1bf9-4d72-8ead-52a5413e6583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:36.528221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63980d7-1bf9-4d72-8ead-52a5413e6583 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.528707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63980d7-1bf9-4d72-8ead-52a5413e6583 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.529218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63980d7-1bf9-4d72-8ead-52a5413e6583 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.545635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63980d7-1bf9-4d72-8ead-52a5413e6583 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-b63980d7-1bf9-4d72-8ead-52a5413e6583 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:36.559868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:36.560805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:36.561596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 121/239] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:36.569181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63980d7-1bf9-4d72-8ead-52a5413e6583 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:36.577833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5420e1e7-87d6-4bdf-a667-fee7944f0039 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:36.698474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e70f5-d98d-439c-85a9-a3a87813e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:36.699730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e70f5-d98d-439c-85a9-a3a87813e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.700213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e70f5-d98d-439c-85a9-a3a87813e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.700684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e70f5-d98d-439c-85a9-a3a87813e6b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.703395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e70f5-d98d-439c-85a9-a3a87813e6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:36.705208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e70f5-d98d-439c-85a9-a3a87813e6b2 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:36.732697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 119/240] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:36.739954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e70f5-d98d-439c-85a9-a3a87813e6b2 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:36.748929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63980d7-1bf9-4d72-8ead-52a5413e6583 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:36.791425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380cbe4-e3fa-40d9-9975-2a2b67975bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:36.792097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380cbe4-e3fa-40d9-9975-2a2b67975bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:36.792387 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380cbe4-e3fa-40d9-9975-2a2b67975bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:36.792656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380cbe4-e3fa-40d9-9975-2a2b67975bf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:36.793463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380cbe4-e3fa-40d9-9975-2a2b67975bf7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:36.793767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380cbe4-e3fa-40d9-9975-2a2b67975bf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:36.795870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380cbe4-e3fa-40d9-9975-2a2b67975bf7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:36.812693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 122/241] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:36.820473 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380cbe4-e3fa-40d9-9975-2a2b67975bf7 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:36.901250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:36.958112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e70f5-d98d-439c-85a9-a3a87813e6b2 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:37.001542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:37.020402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380cbe4-e3fa-40d9-9975-2a2b67975bf7 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:37.022564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b504f-edf9-492c-90fe-fca184b57e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:37.023435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b504f-edf9-492c-90fe-fca184b57e36 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.023849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b504f-edf9-492c-90fe-fca184b57e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.024251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b504f-edf9-492c-90fe-fca184b57e36 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.025095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b504f-edf9-492c-90fe-fca184b57e36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:37.026786 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b504f-edf9-492c-90fe-fca184b57e36 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:37.061038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 120/242] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:36 2022] POST /identity/v3/users => generated 293 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:37.126604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62838f-9069-4873-97b6-336cbe9775fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:37.127534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62838f-9069-4873-97b6-336cbe9775fd None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.127814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62838f-9069-4873-97b6-336cbe9775fd None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.128089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62838f-9069-4873-97b6-336cbe9775fd None admin] PATH_INFO: `/v3/users/a54d1164854f49acbe3d3297ff8614e6` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.129623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b8168-2389-429b-b023-367fda5a0feb None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.130522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b8168-2389-429b-b023-367fda5a0feb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.132993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0b8168-2389-429b-b023-367fda5a0feb None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.135017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 121/243] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:37.142654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ba5e3-835f-4683-b546-be4ee55962bf None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.143289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ba5e3-835f-4683-b546-be4ee55962bf None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.143801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57ba5e3-835f-4683-b546-be4ee55962bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.147440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62838f-9069-4873-97b6-336cbe9775fd None admin] RBAC: Authorizing `identity:get_user(user_id=a54d1164854f49acbe3d3297ff8614e6)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:37.148924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62838f-9069-4873-97b6-336cbe9775fd None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:37.150679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 123/244] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:36 2022] GET /identity/v3/users/a54d1164854f49acbe3d3297ff8614e6 => generated 297 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:37.156829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62838f-9069-4873-97b6-336cbe9775fd None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:37.178115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e57ba5e3-835f-4683-b546-be4ee55962bf None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:37.179680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e57ba5e3-835f-4683-b546-be4ee55962bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:37.265728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 122/245] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:37.307398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ba5e3-835f-4683-b546-be4ee55962bf None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:37.336158 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:37.340409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62838f-9069-4873-97b6-336cbe9775fd None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:37.387280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f328e-80d5-4834-adfc-b85f8fa8ed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:37.387937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f328e-80d5-4834-adfc-b85f8fa8ed86 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.388223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f328e-80d5-4834-adfc-b85f8fa8ed86 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.388501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f328e-80d5-4834-adfc-b85f8fa8ed86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.424762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57ba5e3-835f-4683-b546-be4ee55962bf None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:37.437719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:37.471820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a07c-a1cd-49dd-adfb-cda7508d5492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:37.472918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a07c-a1cd-49dd-adfb-cda7508d5492 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.473337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a07c-a1cd-49dd-adfb-cda7508d5492 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.473612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a07c-a1cd-49dd-adfb-cda7508d5492 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.478197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f328e-80d5-4834-adfc-b85f8fa8ed86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:37.479710 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7f328e-80d5-4834-adfc-b85f8fa8ed86 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:37.486047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13a07c-a1cd-49dd-adfb-cda7508d5492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-ca13a07c-a1cd-49dd-adfb-cda7508d5492 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:37.494614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:37.495738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:37.497051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 123/246] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:37.497898 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4341d-0ccf-4925-b3d2-7aff7b482ed1 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.498121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4341d-0ccf-4925-b3d2-7aff7b482ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.498983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4341d-0ccf-4925-b3d2-7aff7b482ed1 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.499800 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 124/247] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:37.504469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4341d-0ccf-4925-b3d2-7aff7b482ed1 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:37.595979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:37.595979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 124/248] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:04:37.597100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f38975-b2ee-4764-9e4b-753d29f5d40e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.598310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f38975-b2ee-4764-9e4b-753d29f5d40e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.598310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f38975-b2ee-4764-9e4b-753d29f5d40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.618592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-57f38975-b2ee-4764-9e4b-753d29f5d40e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:37.619833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-57f38975-b2ee-4764-9e4b-753d29f5d40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:37.639822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4341d-0ccf-4925-b3d2-7aff7b482ed1 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:37.714476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdb0be-514a-4c33-b0c3-73dcc693c809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:37.717140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdb0be-514a-4c33-b0c3-73dcc693c809 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.717439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdb0be-514a-4c33-b0c3-73dcc693c809 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.717721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdb0be-514a-4c33-b0c3-73dcc693c809 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.718489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdb0be-514a-4c33-b0c3-73dcc693c809 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:37.718803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdb0be-514a-4c33-b0c3-73dcc693c809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:37.724271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdb0be-514a-4c33-b0c3-73dcc693c809 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:37.725540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 125/249] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:37.726169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f38975-b2ee-4764-9e4b-753d29f5d40e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:37.736199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 125/250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:37.737401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e1349-e592-4759-bbcf-738c1a8f6818 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.737699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e1349-e592-4759-bbcf-738c1a8f6818 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.738041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e1349-e592-4759-bbcf-738c1a8f6818 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.739756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 126/251] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:37.747160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e1349-e592-4759-bbcf-738c1a8f6818 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:37.794024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:37.851207 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f38975-b2ee-4764-9e4b-753d29f5d40e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:37.885269 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:37.892105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d8e13-1365-4eee-817f-3db92a12b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:37.892813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e1349-e592-4759-bbcf-738c1a8f6818 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:37.893189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d8e13-1365-4eee-817f-3db92a12b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.893568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d8e13-1365-4eee-817f-3db92a12b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.893936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d8e13-1365-4eee-817f-3db92a12b7c4 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.895916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d8e13-1365-4eee-817f-3db92a12b7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:37.897491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d8e13-1365-4eee-817f-3db92a12b7c4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:37.904335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 126/252] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:37 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:37.905391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d8e13-1365-4eee-817f-3db92a12b7c4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:37.937622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c62670-da6e-462e-9b53-76d634f3eb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:37.938769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c62670-da6e-462e-9b53-76d634f3eb14 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.939084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c62670-da6e-462e-9b53-76d634f3eb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.939625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c62670-da6e-462e-9b53-76d634f3eb14 None admin] PATH_INFO: `/v3/users/18f5a8140eae41bb919f068bb3fc8f23` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.941578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c62670-da6e-462e-9b53-76d634f3eb14 None admin] RBAC: Authorizing `identity:get_user(user_id=18f5a8140eae41bb919f068bb3fc8f23)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:37.943097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c62670-da6e-462e-9b53-76d634f3eb14 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:37.945964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 127/253] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:37 2022] GET /identity/v3/users/18f5a8140eae41bb919f068bb3fc8f23 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:37.947167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce736f5-eed6-4397-be35-097bb852dbcd None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:37.947457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce736f5-eed6-4397-be35-097bb852dbcd None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:37.947737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce736f5-eed6-4397-be35-097bb852dbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:37.967601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-5ce736f5-eed6-4397-be35-097bb852dbcd None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:37.968926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-5ce736f5-eed6-4397-be35-097bb852dbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:38.039766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 128/254] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:38.042572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d8e13-1365-4eee-817f-3db92a12b7c4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:38.043965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce736f5-eed6-4397-be35-097bb852dbcd None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.083890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724762c-110f-4239-8c84-efa6993d315b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:38.084696 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724762c-110f-4239-8c84-efa6993d315b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.084978 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724762c-110f-4239-8c84-efa6993d315b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.085249 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724762c-110f-4239-8c84-efa6993d315b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.091908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:38.098220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724762c-110f-4239-8c84-efa6993d315b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-3724762c-110f-4239-8c84-efa6993d315b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:38.107323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:38.109815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 127/255] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:38.111752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724762c-110f-4239-8c84-efa6993d315b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.167516 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce736f5-eed6-4397-be35-097bb852dbcd None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:38.173490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:38.215624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8961fb1-66c3-4db3-b029-f832e6ea6da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:38.216563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961fb1-66c3-4db3-b029-f832e6ea6da8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.216985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961fb1-66c3-4db3-b029-f832e6ea6da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.217398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8961fb1-66c3-4db3-b029-f832e6ea6da8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.218371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8961fb1-66c3-4db3-b029-f832e6ea6da8 None admin] RBAC: Adding query filter params (role.id=7103b531aa6246d7b44730f73395761f, scope.project.id=91700d043c204f948188f50578e3abdc, user.id=a54d1164854f49acbe3d3297ff8614e6) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:38.218900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8961fb1-66c3-4db3-b029-f832e6ea6da8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:38.220681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724762c-110f-4239-8c84-efa6993d315b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:38.220797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8961fb1-66c3-4db3-b029-f832e6ea6da8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:38.227490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 129/256] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:38 2022] GET /identity/v3/role_assignments?user.id=a54d1164854f49acbe3d3297ff8614e6&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=7103b531aa6246d7b44730f73395761f => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:38.232043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8961fb1-66c3-4db3-b029-f832e6ea6da8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.260387 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5d09f-183b-486a-bf4d-17b8188f1c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:38.261059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d09f-183b-486a-bf4d-17b8188f1c51 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.261348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d09f-183b-486a-bf4d-17b8188f1c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.261624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea5d09f-183b-486a-bf4d-17b8188f1c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.339155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5d09f-183b-486a-bf4d-17b8188f1c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:38.340653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea5d09f-183b-486a-bf4d-17b8188f1c51 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:38.418850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:38.440694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:38.446037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8961fb1-66c3-4db3-b029-f832e6ea6da8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:38.494599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 128/257] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:38.495705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5d09f-183b-486a-bf4d-17b8188f1c51 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.534065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbbd0b-061b-4e43-8f69-433c95947075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:38.534881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbbd0b-061b-4e43-8f69-433c95947075 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.535728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbbd0b-061b-4e43-8f69-433c95947075 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.536018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cbbd0b-061b-4e43-8f69-433c95947075 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.557138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cbbd0b-061b-4e43-8f69-433c95947075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-72cbbd0b-061b-4e43-8f69-433c95947075 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:38.565424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:38.566926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:38.567788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:38.568404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 130/258] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:38.569060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbbd0b-061b-4e43-8f69-433c95947075 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.698537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cbbd0b-061b-4e43-8f69-433c95947075 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:38.710517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea5d09f-183b-486a-bf4d-17b8188f1c51 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:38.737437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6417ce-45de-46f3-861c-6171c56f8c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:38.738843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6417ce-45de-46f3-861c-6171c56f8c08 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.739150 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6417ce-45de-46f3-861c-6171c56f8c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.739431 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6417ce-45de-46f3-861c-6171c56f8c08 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.740833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6417ce-45de-46f3-861c-6171c56f8c08 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:38.742347 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6417ce-45de-46f3-861c-6171c56f8c08 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:38.744186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 131/259] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:38 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:38.745015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6417ce-45de-46f3-861c-6171c56f8c08 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.782927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a4e7-ebff-4020-b674-3a8ddde97ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:38.783630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a4e7-ebff-4020-b674-3a8ddde97ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.783915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a4e7-ebff-4020-b674-3a8ddde97ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.784194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a4e7-ebff-4020-b674-3a8ddde97ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.784977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6a4e7-ebff-4020-b674-3a8ddde97ca5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:38.785323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6a4e7-ebff-4020-b674-3a8ddde97ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:38.786732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6a4e7-ebff-4020-b674-3a8ddde97ca5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:38.798490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:38.810363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 129/260] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:38.811067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a4e7-ebff-4020-b674-3a8ddde97ca5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.838939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:38.883724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6417ce-45de-46f3-861c-6171c56f8c08 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:38.919968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5156d-f961-4054-b451-bc7f217c422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:38.921060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5156d-f961-4054-b451-bc7f217c422e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:38.921542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5156d-f961-4054-b451-bc7f217c422e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:38.922034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b5156d-f961-4054-b451-bc7f217c422e None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:38.923125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5156d-f961-4054-b451-bc7f217c422e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:38.923643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5156d-f961-4054-b451-bc7f217c422e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:38.925367 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b5156d-f961-4054-b451-bc7f217c422e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:38.934661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 132/261] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:38.935754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5156d-f961-4054-b451-bc7f217c422e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:38.969997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a4e7-ebff-4020-b674-3a8ddde97ca5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.031721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:39.036409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0c9ad-2013-4bd9-ba2f-834a367de5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.037176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0c9ad-2013-4bd9-ba2f-834a367de5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.037465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0c9ad-2013-4bd9-ba2f-834a367de5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.037747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb0c9ad-2013-4bd9-ba2f-834a367de5c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.038606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0c9ad-2013-4bd9-ba2f-834a367de5c4 None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=91700d043c204f948188f50578e3abdc, user.id=18f5a8140eae41bb919f068bb3fc8f23) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:39.038896 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0c9ad-2013-4bd9-ba2f-834a367de5c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.040402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb0c9ad-2013-4bd9-ba2f-834a367de5c4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.051374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b5156d-f961-4054-b451-bc7f217c422e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.054414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 130/262] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:38 2022] GET /identity/v3/role_assignments?user.id=18f5a8140eae41bb919f068bb3fc8f23&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:39.055256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0c9ad-2013-4bd9-ba2f-834a367de5c4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.089602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1e85-11a0-4777-82d5-0c0662cd3572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.090867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1e85-11a0-4777-82d5-0c0662cd3572 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.091458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1e85-11a0-4777-82d5-0c0662cd3572 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.091936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb1e85-11a0-4777-82d5-0c0662cd3572 None admin] PATH_INFO: `/v3/users/5f806d31bac74e278919e56134f393f9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.093486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb1e85-11a0-4777-82d5-0c0662cd3572 None admin] RBAC: Authorizing `identity:get_user(user_id=5f806d31bac74e278919e56134f393f9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.095312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb1e85-11a0-4777-82d5-0c0662cd3572 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.097581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 133/263] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:38 2022] GET /identity/v3/users/5f806d31bac74e278919e56134f393f9 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:39.106463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1e85-11a0-4777-82d5-0c0662cd3572 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.197594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:39.232183 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb0c9ad-2013-4bd9-ba2f-834a367de5c4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.323556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb1e85-11a0-4777-82d5-0c0662cd3572 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.327548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55635f-b99a-4d64-a013-3098af0d3589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.328430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55635f-b99a-4d64-a013-3098af0d3589 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.328709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55635f-b99a-4d64-a013-3098af0d3589 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.328979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55635f-b99a-4d64-a013-3098af0d3589 None admin] PATH_INFO: `/v3/users/18f5a8140eae41bb919f068bb3fc8f23` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.334432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55635f-b99a-4d64-a013-3098af0d3589 None admin] RBAC: Authorizing `identity:get_user(user_id=18f5a8140eae41bb919f068bb3fc8f23)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.335953 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55635f-b99a-4d64-a013-3098af0d3589 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.338252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 131/264] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:39 2022] GET /identity/v3/users/18f5a8140eae41bb919f068bb3fc8f23 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:39.345099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55635f-b99a-4d64-a013-3098af0d3589 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.392608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd79d3-0558-4629-9a21-4d90dab57e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.393488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd79d3-0558-4629-9a21-4d90dab57e38 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.393777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd79d3-0558-4629-9a21-4d90dab57e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.394059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd79d3-0558-4629-9a21-4d90dab57e38 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.399750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd79d3-0558-4629-9a21-4d90dab57e38 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.401254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd79d3-0558-4629-9a21-4d90dab57e38 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.403372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 134/265] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:39 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:39.412847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd79d3-0558-4629-9a21-4d90dab57e38 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.453310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:39.504721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55635f-b99a-4d64-a013-3098af0d3589 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.555035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6dfcfb-8e29-4e90-8ba0-7ada2558d103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.556050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dfcfb-8e29-4e90-8ba0-7ada2558d103 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.556541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dfcfb-8e29-4e90-8ba0-7ada2558d103 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.557017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6dfcfb-8e29-4e90-8ba0-7ada2558d103 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.588276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:39.655046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd79d3-0558-4629-9a21-4d90dab57e38 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:39.688070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6dfcfb-8e29-4e90-8ba0-7ada2558d103 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.689558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6dfcfb-8e29-4e90-8ba0-7ada2558d103 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.698987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0826280-3447-412b-9218-eeceddae42ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:39.700160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0826280-3447-412b-9218-eeceddae42ee None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.700665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0826280-3447-412b-9218-eeceddae42ee None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.701143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0826280-3447-412b-9218-eeceddae42ee None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc/users/5f806d31bac74e278919e56134f393f9/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.703396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0826280-3447-412b-9218-eeceddae42ee None admin] RBAC: Authorizing `identity:create_grant(project_id=91700d043c204f948188f50578e3abdc, user_id=5f806d31bac74e278919e56134f393f9, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:39.705171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0826280-3447-412b-9218-eeceddae42ee None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:39.731605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 135/266] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:39 2022] PUT /identity/v3/projects/91700d043c204f948188f50578e3abdc/users/5f806d31bac74e278919e56134f393f9/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:04:39.818449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 132/267] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:04:39.824545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0826280-3447-412b-9218-eeceddae42ee None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:39.877853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaca7d-d9f5-4c23-ac62-dc45268d086b None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.878168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaca7d-d9f5-4c23-ac62-dc45268d086b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.878414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaca7d-d9f5-4c23-ac62-dc45268d086b None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.880871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 133/268] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:39.886512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb95c-0914-4e05-954e-4c509fcc8e4f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:39.886805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb95c-0914-4e05-954e-4c509fcc8e4f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:39.887105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559eb95c-0914-4e05-954e-4c509fcc8e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:39.917432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-559eb95c-0914-4e05-954e-4c509fcc8e4f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:39.920347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-559eb95c-0914-4e05-954e-4c509fcc8e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:39.961424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:39.986852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0826280-3447-412b-9218-eeceddae42ee None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.001972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.028514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c282f38d-9b60-47c8-9afd-4ecd27880658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.029752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f38d-9b60-47c8-9afd-4ecd27880658 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.030109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f38d-9b60-47c8-9afd-4ecd27880658 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.030482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c282f38d-9b60-47c8-9afd-4ecd27880658 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.031802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282f38d-9b60-47c8-9afd-4ecd27880658 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.032693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 134/269] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:40.033500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c282f38d-9b60-47c8-9afd-4ecd27880658 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.034096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff929-0e1f-4f5e-8693-f28c9a0d4c9d None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.034387 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff929-0e1f-4f5e-8693-f28c9a0d4c9d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.034664 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eff929-0e1f-4f5e-8693-f28c9a0d4c9d None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.036089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 136/270] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:39 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:40.037116 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 135/271] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:40.042044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eff929-0e1f-4f5e-8693-f28c9a0d4c9d None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.042381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050d1d0-dae2-4865-a6bb-3dbf89407219 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.042682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050d1d0-dae2-4865-a6bb-3dbf89407219 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.042980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050d1d0-dae2-4865-a6bb-3dbf89407219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.065757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d050d1d0-dae2-4865-a6bb-3dbf89407219 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:40.067360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d050d1d0-dae2-4865-a6bb-3dbf89407219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:40.144632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 137/272] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:40.147256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050d1d0-dae2-4865-a6bb-3dbf89407219 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.187053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eff929-0e1f-4f5e-8693-f28c9a0d4c9d None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.234899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9db22e-c9c5-4836-afa3-10c96553b86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.235868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9db22e-c9c5-4836-afa3-10c96553b86d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.236164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9db22e-c9c5-4836-afa3-10c96553b86d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.236447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9db22e-c9c5-4836-afa3-10c96553b86d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.237573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9db22e-c9c5-4836-afa3-10c96553b86d None admin] RBAC: Adding query filter params (role.id=b29b8d5f31b44d8b90eb10c34acbc06a, scope.project.id=91700d043c204f948188f50578e3abdc, user.id=18f5a8140eae41bb919f068bb3fc8f23) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:40.239505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9db22e-c9c5-4836-afa3-10c96553b86d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.245359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9db22e-c9c5-4836-afa3-10c96553b86d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.249081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.256106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 136/273] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/role_assignments?user.id=18f5a8140eae41bb919f068bb3fc8f23&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=b29b8d5f31b44d8b90eb10c34acbc06a => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:40.258007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9db22e-c9c5-4836-afa3-10c96553b86d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.315057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d050d1d0-dae2-4865-a6bb-3dbf89407219 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.342711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.374234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730002e-4e6c-4cfd-a850-c0b52a761d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.375836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730002e-4e6c-4cfd-a850-c0b52a761d5c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.376393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730002e-4e6c-4cfd-a850-c0b52a761d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.377140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730002e-4e6c-4cfd-a850-c0b52a761d5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.378687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730002e-4e6c-4cfd-a850-c0b52a761d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.381955 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730002e-4e6c-4cfd-a850-c0b52a761d5c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.384756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 138/274] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:40.396138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730002e-4e6c-4cfd-a850-c0b52a761d5c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.449012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9db22e-c9c5-4836-afa3-10c96553b86d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.485658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aff23-09cf-4003-8e10-c95da77637c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.486886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aff23-09cf-4003-8e10-c95da77637c9 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.487399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aff23-09cf-4003-8e10-c95da77637c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.487909 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510aff23-09cf-4003-8e10-c95da77637c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.500683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510aff23-09cf-4003-8e10-c95da77637c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-510aff23-09cf-4003-8e10-c95da77637c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:40.509514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:40.510415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:40.511258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:40.514014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 137/275] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:40.520406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aff23-09cf-4003-8e10-c95da77637c9 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.524386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730002e-4e6c-4cfd-a850-c0b52a761d5c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.562463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95644b-aca1-4200-b798-ca505df0bf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.563165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95644b-aca1-4200-b798-ca505df0bf57 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.563451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95644b-aca1-4200-b798-ca505df0bf57 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.563727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95644b-aca1-4200-b798-ca505df0bf57 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.564559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95644b-aca1-4200-b798-ca505df0bf57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.566039 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f95644b-aca1-4200-b798-ca505df0bf57 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.594818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 139/276] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:04:40 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:40.640991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510aff23-09cf-4003-8e10-c95da77637c9 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.650304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.690967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36896b4-0bb1-4a7d-9401-5279aaa7c5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.692334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36896b4-0bb1-4a7d-9401-5279aaa7c5da None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.692682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36896b4-0bb1-4a7d-9401-5279aaa7c5da None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.692964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36896b4-0bb1-4a7d-9401-5279aaa7c5da None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.693784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36896b4-0bb1-4a7d-9401-5279aaa7c5da None admin] RBAC: Adding query filter params (name=member) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:40.694095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36896b4-0bb1-4a7d-9401-5279aaa7c5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.695559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36896b4-0bb1-4a7d-9401-5279aaa7c5da None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.710493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 138/277] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:40.716523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95644b-aca1-4200-b798-ca505df0bf57 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.719419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.826134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22346c59-1263-442e-83bc-255b12fd1d89 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.826605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22346c59-1263-442e-83bc-255b12fd1d89 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.826918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22346c59-1263-442e-83bc-255b12fd1d89 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.828462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 139/278] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:40.832473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95644b-aca1-4200-b798-ca505df0bf57 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:40.837889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc1ea-a498-422d-8265-a33ec7ab11c6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.838221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc1ea-a498-422d-8265-a33ec7ab11c6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.838507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737fc1ea-a498-422d-8265-a33ec7ab11c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.864979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-737fc1ea-a498-422d-8265-a33ec7ab11c6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:40.866266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-737fc1ea-a498-422d-8265-a33ec7ab11c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:40.872337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67c5fc-856b-42e1-b88c-11577a49ffa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:40.873219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c5fc-856b-42e1-b88c-11577a49ffa3 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:40.873498 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c5fc-856b-42e1-b88c-11577a49ffa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:40.873770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c5fc-856b-42e1-b88c-11577a49ffa3 None admin] PATH_INFO: `/v3/users/b098546ad1c94791bba215d7aa55cbda` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:40.890507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67c5fc-856b-42e1-b88c-11577a49ffa3 None admin] RBAC: Authorizing `identity:get_user(user_id=b098546ad1c94791bba215d7aa55cbda)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:40.892146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67c5fc-856b-42e1-b88c-11577a49ffa3 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:40.894199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 140/279] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/users/b098546ad1c94791bba215d7aa55cbda => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:40.901331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67c5fc-856b-42e1-b88c-11577a49ffa3 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:40.951788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 140/280] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:40.975586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:40.976272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc1ea-a498-422d-8265-a33ec7ab11c6 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.023848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67c5fc-856b-42e1-b88c-11577a49ffa3 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.067436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc45a90-170d-47d3-b7fb-ffe23166004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.068262 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc45a90-170d-47d3-b7fb-ffe23166004e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.069014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc45a90-170d-47d3-b7fb-ffe23166004e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.069414 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc45a90-170d-47d3-b7fb-ffe23166004e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.070662 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc45a90-170d-47d3-b7fb-ffe23166004e None admin] RBAC: Adding query filter params (role.id=49806c1799404d039cb4e2a11f1d4442, user.id=b098546ad1c94791bba215d7aa55cbda, scope.system=all) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:41.071112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc45a90-170d-47d3-b7fb-ffe23166004e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.072986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc45a90-170d-47d3-b7fb-ffe23166004e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.080056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 141/281] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/role_assignments?user.id=b098546ad1c94791bba215d7aa55cbda&scope.system=all&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:41.095377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:41.099674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737fc1ea-a498-422d-8265-a33ec7ab11c6 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.138314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f27c4-19a3-4138-ae04-9b63a90b4101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.139157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f27c4-19a3-4138-ae04-9b63a90b4101 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.139445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f27c4-19a3-4138-ae04-9b63a90b4101 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.139722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f27c4-19a3-4138-ae04-9b63a90b4101 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.152546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f27c4-19a3-4138-ae04-9b63a90b4101 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-cd4f27c4-19a3-4138-ae04-9b63a90b4101 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:41.161407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:41.162372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:41.163198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 141/282] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:41.168702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc45a90-170d-47d3-b7fb-ffe23166004e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.313856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc45a90-170d-47d3-b7fb-ffe23166004e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.341132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:41.354270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5cca7-e0a2-4d70-bd98-d903df500ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.354948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5cca7-e0a2-4d70-bd98-d903df500ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.355267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5cca7-e0a2-4d70-bd98-d903df500ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.355551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d5cca7-e0a2-4d70-bd98-d903df500ff8 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.356495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5cca7-e0a2-4d70-bd98-d903df500ff8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:41.356813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5cca7-e0a2-4d70-bd98-d903df500ff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.358229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d5cca7-e0a2-4d70-bd98-d903df500ff8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.368790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 142/283] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:41.374353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f27c4-19a3-4138-ae04-9b63a90b4101 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.515142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f27c4-19a3-4138-ae04-9b63a90b4101 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.554886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7b503-975c-463b-a1c6-4b1f39e4c5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.555804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b503-975c-463b-a1c6-4b1f39e4c5df None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.556098 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b503-975c-463b-a1c6-4b1f39e4c5df None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.556378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7b503-975c-463b-a1c6-4b1f39e4c5df None admin] PATH_INFO: `/v3/users/a54d1164854f49acbe3d3297ff8614e6` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.557641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7b503-975c-463b-a1c6-4b1f39e4c5df None admin] RBAC: Authorizing `identity:get_user(user_id=a54d1164854f49acbe3d3297ff8614e6)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.559142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7b503-975c-463b-a1c6-4b1f39e4c5df None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.561117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 142/284] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:41 2022] GET /identity/v3/users/a54d1164854f49acbe3d3297ff8614e6 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:41.566973 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5cca7-e0a2-4d70-bd98-d903df500ff8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.721782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d5cca7-e0a2-4d70-bd98-d903df500ff8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.766300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6942e3-9cc2-4536-9d0d-134df8dd3fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.767132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6942e3-9cc2-4536-9d0d-134df8dd3fdd None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.767420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6942e3-9cc2-4536-9d0d-134df8dd3fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.767699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6942e3-9cc2-4536-9d0d-134df8dd3fdd None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.768992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6942e3-9cc2-4536-9d0d-134df8dd3fdd None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.770534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6942e3-9cc2-4536-9d0d-134df8dd3fdd None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.772312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 143/285] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:41 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:41.778216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7b503-975c-463b-a1c6-4b1f39e4c5df None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:41.811748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:41.912339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7b503-975c-463b-a1c6-4b1f39e4c5df None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:41.961480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049568dd-e7fb-4f8d-bf5b-7246102f5a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:41.963039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049568dd-e7fb-4f8d-bf5b-7246102f5a40 None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:41.963525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049568dd-e7fb-4f8d-bf5b-7246102f5a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:41.963997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049568dd-e7fb-4f8d-bf5b-7246102f5a40 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc/users/a54d1164854f49acbe3d3297ff8614e6/roles/7103b531aa6246d7b44730f73395761f` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:41.966753 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049568dd-e7fb-4f8d-bf5b-7246102f5a40 None admin] RBAC: Authorizing `identity:create_grant(project_id=91700d043c204f948188f50578e3abdc, user_id=a54d1164854f49acbe3d3297ff8614e6, role_id=7103b531aa6246d7b44730f73395761f)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:41.968463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049568dd-e7fb-4f8d-bf5b-7246102f5a40 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:41.996831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 143/286] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:04:41 2022] PUT /identity/v3/projects/91700d043c204f948188f50578e3abdc/users/a54d1164854f49acbe3d3297ff8614e6/roles/7103b531aa6246d7b44730f73395761f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:42.325391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310856-e016-4283-ab67-e81b18dcd33e None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:42.326114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310856-e016-4283-ab67-e81b18dcd33e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:42.326604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3310856-e016-4283-ab67-e81b18dcd33e None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:42.328258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 144/287] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:42.333953 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df410e1d-b83c-4857-bd80-57eb62a0b80d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:42.334503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df410e1d-b83c-4857-bd80-57eb62a0b80d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:42.335008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df410e1d-b83c-4857-bd80-57eb62a0b80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:42.353374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-df410e1d-b83c-4857-bd80-57eb62a0b80d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:42.354865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-df410e1d-b83c-4857-bd80-57eb62a0b80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:42.445549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 144/288] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:42.483644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310856-e016-4283-ab67-e81b18dcd33e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:42.554013 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:42.620475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3310856-e016-4283-ab67-e81b18dcd33e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:42.660522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efbe87-bb0e-4d05-8966-e605ba7480ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:42.661761 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efbe87-bb0e-4d05-8966-e605ba7480ef None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:42.662246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efbe87-bb0e-4d05-8966-e605ba7480ef None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:42.662719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03efbe87-bb0e-4d05-8966-e605ba7480ef None admin] PATH_INFO: `/v3/roles/member` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:42.673852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03efbe87-bb0e-4d05-8966-e605ba7480ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-03efbe87-bb0e-4d05-8966-e605ba7480ef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:42.682742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:42.683627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:42.684441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:42.686913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 145/289] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:42.693609 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df410e1d-b83c-4857-bd80-57eb62a0b80d None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:42.715672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:42.816020 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df410e1d-b83c-4857-bd80-57eb62a0b80d None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:42.853313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796afdb-2488-45d4-884d-7352a0c85f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:42.854007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796afdb-2488-45d4-884d-7352a0c85f81 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:42.854284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796afdb-2488-45d4-884d-7352a0c85f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:42.854566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796afdb-2488-45d4-884d-7352a0c85f81 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:42.855357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796afdb-2488-45d4-884d-7352a0c85f81 None admin] RBAC: Adding query filter params (name=member) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:42.855671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796afdb-2488-45d4-884d-7352a0c85f81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:42.857073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796afdb-2488-45d4-884d-7352a0c85f81 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:42.866161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 145/290] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:42.872019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efbe87-bb0e-4d05-8966-e605ba7480ef None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:43.011818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03efbe87-bb0e-4d05-8966-e605ba7480ef None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:43.030059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:43.057378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa88906-2685-404f-b4e3-220698133077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:43.058258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88906-2685-404f-b4e3-220698133077 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.058543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88906-2685-404f-b4e3-220698133077 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.058819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa88906-2685-404f-b4e3-220698133077 None admin] PATH_INFO: `/v3/users/5f806d31bac74e278919e56134f393f9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.060064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa88906-2685-404f-b4e3-220698133077 None admin] RBAC: Authorizing `identity:get_user(user_id=5f806d31bac74e278919e56134f393f9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:43.061526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa88906-2685-404f-b4e3-220698133077 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:43.063394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 146/291] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:42 2022] GET /identity/v3/users/5f806d31bac74e278919e56134f393f9 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:43.069266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796afdb-2488-45d4-884d-7352a0c85f81 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:43.150118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:43.189206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796afdb-2488-45d4-884d-7352a0c85f81 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:43.244773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0763b9e-7819-4997-b689-3d93aef9d0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:43.245428 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0763b9e-7819-4997-b689-3d93aef9d0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.245714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0763b9e-7819-4997-b689-3d93aef9d0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.245998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0763b9e-7819-4997-b689-3d93aef9d0b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.328382 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0763b9e-7819-4997-b689-3d93aef9d0b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:43.329773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0763b9e-7819-4997-b689-3d93aef9d0b7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:43.430125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:43.453168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 146/292] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:43.459265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa88906-2685-404f-b4e3-220698133077 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:43.469323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b4db-f624-4493-9742-a50728b00b7e None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.469631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b4db-f624-4493-9742-a50728b00b7e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.469876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5b4db-f624-4493-9742-a50728b00b7e None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.471303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 147/293] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:43 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:43.478945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b55e5-2aa6-49f2-b24f-073466c650e0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.479268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b55e5-2aa6-49f2-b24f-073466c650e0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.479586 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b55e5-2aa6-49f2-b24f-073466c650e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.506815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e36b55e5-2aa6-49f2-b24f-073466c650e0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:43.508040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e36b55e5-2aa6-49f2-b24f-073466c650e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:43.616357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa88906-2685-404f-b4e3-220698133077 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:43.623227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 148/294] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:43.624616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc8e09-b1a8-4d81-9c2b-189203bf5209 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.624906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc8e09-b1a8-4d81-9c2b-189203bf5209 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.625186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc8e09-b1a8-4d81-9c2b-189203bf5209 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.626626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 149/295] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:43.632441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846490-9b3f-4067-ba97-1d1607ad6d39 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.632739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846490-9b3f-4067-ba97-1d1607ad6d39 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.633021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b846490-9b3f-4067-ba97-1d1607ad6d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.650913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-6b846490-9b3f-4067-ba97-1d1607ad6d39 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:43.652235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6b846490-9b3f-4067-ba97-1d1607ad6d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:43.662429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91b8ff-0347-4065-be20-77913794c8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:43.664045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91b8ff-0347-4065-be20-77913794c8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.664533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91b8ff-0347-4065-be20-77913794c8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.665010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e91b8ff-0347-4065-be20-77913794c8b9 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.666442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91b8ff-0347-4065-be20-77913794c8b9 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:43.668160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e91b8ff-0347-4065-be20-77913794c8b9 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:43.670406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 147/296] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:43 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:43.671502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91b8ff-0347-4065-be20-77913794c8b9 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:43.733412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:43.734729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 150/297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:43.741099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846490-9b3f-4067-ba97-1d1607ad6d39 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:43.789657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e91b8ff-0347-4065-be20-77913794c8b9 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:43.790142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:43.830318 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd980bf8-eee0-41a9-8c1b-d3963930ece3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:43.831150 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd980bf8-eee0-41a9-8c1b-d3963930ece3 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.831436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd980bf8-eee0-41a9-8c1b-d3963930ece3 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.831714 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd980bf8-eee0-41a9-8c1b-d3963930ece3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.844091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd980bf8-eee0-41a9-8c1b-d3963930ece3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-dd980bf8-eee0-41a9-8c1b-d3963930ece3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:43.851851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:43.852784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:43.858572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:43.859246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b846490-9b3f-4067-ba97-1d1607ad6d39 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:43.859319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 148/298] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:43.859319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f77083-cf4c-433e-b325-67d87e92ad15 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.859319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f77083-cf4c-433e-b325-67d87e92ad15 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.859319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f77083-cf4c-433e-b325-67d87e92ad15 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.859319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 149/299] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:43.859319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f77083-cf4c-433e-b325-67d87e92ad15 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:43.896629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37467e70-2428-46e4-8cf0-32c96056116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:43.897211 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37467e70-2428-46e4-8cf0-32c96056116c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:43.897496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37467e70-2428-46e4-8cf0-32c96056116c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:43.897774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37467e70-2428-46e4-8cf0-32c96056116c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:43.898608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37467e70-2428-46e4-8cf0-32c96056116c None admin] RBAC: Adding query filter params (role.id=49806c1799404d039cb4e2a11f1d4442, scope.project.id=91700d043c204f948188f50578e3abdc, user.id=5f806d31bac74e278919e56134f393f9) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:43.898926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37467e70-2428-46e4-8cf0-32c96056116c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:43.900421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37467e70-2428-46e4-8cf0-32c96056116c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:43.907157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 151/300] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:43 2022] GET /identity/v3/role_assignments?user.id=5f806d31bac74e278919e56134f393f9&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:43.907767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37467e70-2428-46e4-8cf0-32c96056116c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:43.973279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f77083-cf4c-433e-b325-67d87e92ad15 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:43.986006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.018503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ca2a9-4941-4890-9c1e-0669b9be0e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.020029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ca2a9-4941-4890-9c1e-0669b9be0e63 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.020429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ca2a9-4941-4890-9c1e-0669b9be0e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.020887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ca2a9-4941-4890-9c1e-0669b9be0e63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.022139 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ca2a9-4941-4890-9c1e-0669b9be0e63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.023655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ca2a9-4941-4890-9c1e-0669b9be0e63 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.025771 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 150/301] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:44.027105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b241-4766-4ee9-bc4c-82a3bc05564f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.027444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b241-4766-4ee9-bc4c-82a3bc05564f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.027724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a5b241-4766-4ee9-bc4c-82a3bc05564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.045632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b7a5b241-4766-4ee9-bc4c-82a3bc05564f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:44.046907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b7a5b241-4766-4ee9-bc4c-82a3bc05564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:44.057749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37467e70-2428-46e4-8cf0-32c96056116c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.060396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.104253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca1426-7785-40e9-9997-f5d8e77340d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.105785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca1426-7785-40e9-9997-f5d8e77340d0 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.107087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca1426-7785-40e9-9997-f5d8e77340d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.107087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca1426-7785-40e9-9997-f5d8e77340d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.107251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca1426-7785-40e9-9997-f5d8e77340d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:44.108232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca1426-7785-40e9-9997-f5d8e77340d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.108997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca1426-7785-40e9-9997-f5d8e77340d0 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.120557 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 152/302] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:44.121226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca1426-7785-40e9-9997-f5d8e77340d0 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.156014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 151/303] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:44.156014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b241-4766-4ee9-bc4c-82a3bc05564f None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.247350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca1426-7785-40e9-9997-f5d8e77340d0 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.283666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d03c2-e65d-422b-a58e-90fc27d65a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.284611 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d03c2-e65d-422b-a58e-90fc27d65a4e None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.285063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d03c2-e65d-422b-a58e-90fc27d65a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.286016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d03c2-e65d-422b-a58e-90fc27d65a4e None admin] PATH_INFO: `/v3/groups` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.286182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a5b241-4766-4ee9-bc4c-82a3bc05564f None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.287050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d03c2-e65d-422b-a58e-90fc27d65a4e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.289894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d03c2-e65d-422b-a58e-90fc27d65a4e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.296353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.308240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 153/304] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Jul 21 04:04:44 2022] POST /identity/v3/groups => generated 229 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:04:44.316033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d03c2-e65d-422b-a58e-90fc27d65a4e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.324548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f6249-0766-4350-b369-f13870bff03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.325584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f6249-0766-4350-b369-f13870bff03d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.325944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f6249-0766-4350-b369-f13870bff03d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.326298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028f6249-0766-4350-b369-f13870bff03d None admin] PATH_INFO: `/v3/users/c8da16de56bf435e9a45486da3f5525d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.343996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f6249-0766-4350-b369-f13870bff03d None admin] RBAC: Authorizing `identity:get_user(user_id=c8da16de56bf435e9a45486da3f5525d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.346334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028f6249-0766-4350-b369-f13870bff03d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.349429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 152/305] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/users/c8da16de56bf435e9a45486da3f5525d => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:44.355257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f6249-0766-4350-b369-f13870bff03d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.359280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.473955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d03c2-e65d-422b-a58e-90fc27d65a4e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.485550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028f6249-0766-4350-b369-f13870bff03d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.512503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dde3e8-b968-43b2-8def-9a63958cae3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.513872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dde3e8-b968-43b2-8def-9a63958cae3d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.513872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dde3e8-b968-43b2-8def-9a63958cae3d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.514121 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dde3e8-b968-43b2-8def-9a63958cae3d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.526605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dde3e8-b968-43b2-8def-9a63958cae3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:44.529371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa23e4-9da7-417c-81f2-f498d467d3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.530237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa23e4-9da7-417c-81f2-f498d467d3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.531472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa23e4-9da7-417c-81f2-f498d467d3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.531472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa23e4-9da7-417c-81f2-f498d467d3b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.531729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa23e4-9da7-417c-81f2-f498d467d3b2 None admin] RBAC: Adding query filter params (role.id=7103b531aa6246d7b44730f73395761f, user.id=c8da16de56bf435e9a45486da3f5525d, scope.system=all) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:44.532479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa23e4-9da7-417c-81f2-f498d467d3b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.533480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa23e4-9da7-417c-81f2-f498d467d3b2 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-a4dde3e8-b968-43b2-8def-9a63958cae3d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:44.534913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:44.536889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:44.537684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 154/306] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:44.543940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 153/307] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/role_assignments?user.id=c8da16de56bf435e9a45486da3f5525d&scope.system=all&role.id=7103b531aa6246d7b44730f73395761f => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:44.545063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dde3e8-b968-43b2-8def-9a63958cae3d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.624618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dda65-9bb9-4a19-88ab-06fbd65cca0f None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.624913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dda65-9bb9-4a19-88ab-06fbd65cca0f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.625185 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dda65-9bb9-4a19-88ab-06fbd65cca0f None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.626575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 154/308] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:44.632629 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071f17e-2acc-40fa-9c2b-8d84461cc6a4 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.632916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071f17e-2acc-40fa-9c2b-8d84461cc6a4 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.633357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071f17e-2acc-40fa-9c2b-8d84461cc6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.654451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.658077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a071f17e-2acc-40fa-9c2b-8d84461cc6a4 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:44.659895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a071f17e-2acc-40fa-9c2b-8d84461cc6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:44.674811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dde3e8-b968-43b2-8def-9a63958cae3d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.698258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.720191 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4e966-9ff4-49a7-bbaf-f5507d314ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.721112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4e966-9ff4-49a7-bbaf-f5507d314ccc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.721560 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4e966-9ff4-49a7-bbaf-f5507d314ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.721982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb4e966-9ff4-49a7-bbaf-f5507d314ccc None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.723167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4e966-9ff4-49a7-bbaf-f5507d314ccc None admin] RBAC: Adding query filter params (name=member) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:44.723769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4e966-9ff4-49a7-bbaf-f5507d314ccc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.725505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb4e966-9ff4-49a7-bbaf-f5507d314ccc None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.742264 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 155/309] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:44.749241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4e966-9ff4-49a7-bbaf-f5507d314ccc None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.759978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 155/310] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:44.784114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071f17e-2acc-40fa-9c2b-8d84461cc6a4 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.885610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb4e966-9ff4-49a7-bbaf-f5507d314ccc None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.912682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071f17e-2acc-40fa-9c2b-8d84461cc6a4 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:44.932995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961d502-ffb1-4d2e-9e10-0b4836514051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.934573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d502-ffb1-4d2e-9e10-0b4836514051 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.935030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d502-ffb1-4d2e-9e10-0b4836514051 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.935696 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961d502-ffb1-4d2e-9e10-0b4836514051 None admin] PATH_INFO: `/v3/users/b098546ad1c94791bba215d7aa55cbda` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.937217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961d502-ffb1-4d2e-9e10-0b4836514051 None admin] RBAC: Authorizing `identity:get_user(user_id=b098546ad1c94791bba215d7aa55cbda)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:44.939396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c961d502-ffb1-4d2e-9e10-0b4836514051 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:44.947572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 156/311] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/users/b098546ad1c94791bba215d7aa55cbda => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:44.949327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961d502-ffb1-4d2e-9e10-0b4836514051 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:44.953013 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e49376-4b98-4491-8cef-44679ec682ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:44.953995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e49376-4b98-4491-8cef-44679ec682ca None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:44.954449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e49376-4b98-4491-8cef-44679ec682ca None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:44.954884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e49376-4b98-4491-8cef-44679ec682ca None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:44.967066 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e49376-4b98-4491-8cef-44679ec682ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:44.968837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-46e49376-4b98-4491-8cef-44679ec682ca None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:44.976944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:44.978359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:44.979229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:44.986335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 156/312] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:44.987532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e49376-4b98-4491-8cef-44679ec682ca None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:45.012206 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:45.078044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c961d502-ffb1-4d2e-9e10-0b4836514051 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:45.099946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e49376-4b98-4491-8cef-44679ec682ca None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:45.119931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843d3c2-c072-4d54-9b0e-fc0e8f8d4c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:45.121187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843d3c2-c072-4d54-9b0e-fc0e8f8d4c47 None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.121485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843d3c2-c072-4d54-9b0e-fc0e8f8d4c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.121769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843d3c2-c072-4d54-9b0e-fc0e8f8d4c47 None admin] PATH_INFO: `/v3/system/users/b098546ad1c94791bba215d7aa55cbda/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.123315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843d3c2-c072-4d54-9b0e-fc0e8f8d4c47 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b098546ad1c94791bba215d7aa55cbda, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:45.125284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843d3c2-c072-4d54-9b0e-fc0e8f8d4c47 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:45.138319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 157/313] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Jul 21 04:04:44 2022] PUT /identity/v3/system/users/b098546ad1c94791bba215d7aa55cbda/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:04:45.149121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a46359-9361-4d1f-afd9-87fb01f9c91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:45.150143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a46359-9361-4d1f-afd9-87fb01f9c91e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.150575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a46359-9361-4d1f-afd9-87fb01f9c91e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.151037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a46359-9361-4d1f-afd9-87fb01f9c91e None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.152116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a46359-9361-4d1f-afd9-87fb01f9c91e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:45.152674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a46359-9361-4d1f-afd9-87fb01f9c91e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:45.154417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a46359-9361-4d1f-afd9-87fb01f9c91e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:45.165498 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 157/314] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:45.171513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843d3c2-c072-4d54-9b0e-fc0e8f8d4c47 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:45.274692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:45.302139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843d3c2-c072-4d54-9b0e-fc0e8f8d4c47 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:45.339745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bfa41-2f50-4ca5-b876-5376f4e5be82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:45.340628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bfa41-2f50-4ca5-b876-5376f4e5be82 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.340968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bfa41-2f50-4ca5-b876-5376f4e5be82 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.341248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bfa41-2f50-4ca5-b876-5376f4e5be82 None admin] PATH_INFO: `/v3/users/a54d1164854f49acbe3d3297ff8614e6` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.342547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bfa41-2f50-4ca5-b876-5376f4e5be82 None admin] RBAC: Authorizing `identity:get_user(user_id=a54d1164854f49acbe3d3297ff8614e6)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:45.344069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bfa41-2f50-4ca5-b876-5376f4e5be82 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:45.346081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 158/315] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:45 2022] GET /identity/v3/users/a54d1164854f49acbe3d3297ff8614e6 => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:45.352166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a46359-9361-4d1f-afd9-87fb01f9c91e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:45.439624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:45.458893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a46359-9361-4d1f-afd9-87fb01f9c91e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:45.494350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e08b18-c127-4db1-b2a7-258fa008a80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:45.495026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e08b18-c127-4db1-b2a7-258fa008a80f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.495312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e08b18-c127-4db1-b2a7-258fa008a80f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.495587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e08b18-c127-4db1-b2a7-258fa008a80f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.577054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e08b18-c127-4db1-b2a7-258fa008a80f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:45.578599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e08b18-c127-4db1-b2a7-258fa008a80f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:45.662052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:45.682129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 158/316] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:45.687380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bfa41-2f50-4ca5-b876-5376f4e5be82 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:45.798700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bfa41-2f50-4ca5-b876-5376f4e5be82 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:45.834812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba0e46-e148-4555-9c49-4eb932213fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:45.836014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba0e46-e148-4555-9c49-4eb932213fdb None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.836516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba0e46-e148-4555-9c49-4eb932213fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.837005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba0e46-e148-4555-9c49-4eb932213fdb None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.838906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba0e46-e148-4555-9c49-4eb932213fdb None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:45.840584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba0e46-e148-4555-9c49-4eb932213fdb None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:45.842702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 159/317] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:45 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:45.851192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e08b18-c127-4db1-b2a7-258fa008a80f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:45.952786 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e08b18-c127-4db1-b2a7-258fa008a80f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:45.989070 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2eb001-91e4-4072-b508-1c0ae66ecd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:45.989812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2eb001-91e4-4072-b508-1c0ae66ecd97 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:45.990100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2eb001-91e4-4072-b508-1c0ae66ecd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:45.990380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2eb001-91e4-4072-b508-1c0ae66ecd97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:45.991238 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2eb001-91e4-4072-b508-1c0ae66ecd97 None admin] RBAC: Adding query filter params (role.id=7103b531aa6246d7b44730f73395761f, scope.project.id=91700d043c204f948188f50578e3abdc, user.id=a54d1164854f49acbe3d3297ff8614e6) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:45.991551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2eb001-91e4-4072-b508-1c0ae66ecd97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:45.993028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2eb001-91e4-4072-b508-1c0ae66ecd97 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:45.999504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 159/318] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:04:45 2022] GET /identity/v3/role_assignments?user.id=a54d1164854f49acbe3d3297ff8614e6&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=7103b531aa6246d7b44730f73395761f => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:46.516321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51182b13-9b82-407e-861e-309949a49cc2 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.516930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51182b13-9b82-407e-861e-309949a49cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.517416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51182b13-9b82-407e-861e-309949a49cc2 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.519962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 160/319] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:46.524706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7ed3e-9cec-47f7-98c2-9f0a4962cc14 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.524994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7ed3e-9cec-47f7-98c2-9f0a4962cc14 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.525267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7ed3e-9cec-47f7-98c2-9f0a4962cc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.542200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-79a7ed3e-9cec-47f7-98c2-9f0a4962cc14 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:46.543411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-79a7ed3e-9cec-47f7-98c2-9f0a4962cc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:46.586795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:46.612641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 160/320] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:46.635003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51182b13-9b82-407e-861e-309949a49cc2 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:46.652167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:46.703304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ad45c-af9e-4792-a0bb-3eea5a26af72 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.703613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ad45c-af9e-4792-a0bb-3eea5a26af72 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.703879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ad45c-af9e-4792-a0bb-3eea5a26af72 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.705262 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 161/321] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:46.711207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057a58-401e-403e-a846-d26c456a4431 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.711498 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057a58-401e-403e-a846-d26c456a4431 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.711773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d057a58-401e-403e-a846-d26c456a4431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.728240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-7d057a58-401e-403e-a846-d26c456a4431 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:46.729413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7d057a58-401e-403e-a846-d26c456a4431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:46.746590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51182b13-9b82-407e-861e-309949a49cc2 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:46.783613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b6ec8-5cf9-4c83-8cdc-7fdaa3bb20e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:46.784329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6ec8-5cf9-4c83-8cdc-7fdaa3bb20e8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.784618 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6ec8-5cf9-4c83-8cdc-7fdaa3bb20e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.784899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b6ec8-5cf9-4c83-8cdc-7fdaa3bb20e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.786256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b6ec8-5cf9-4c83-8cdc-7fdaa3bb20e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:46.787746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b6ec8-5cf9-4c83-8cdc-7fdaa3bb20e8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:46.789382 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 161/322] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:04:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:46.794787 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b6ec8-5cf9-4c83-8cdc-7fdaa3bb20e8 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:46.807915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 162/323] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:46.830557 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057a58-401e-403e-a846-d26c456a4431 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:46.891293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:46.911163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b6ec8-5cf9-4c83-8cdc-7fdaa3bb20e8 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:46.941124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d057a58-401e-403e-a846-d26c456a4431 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:46.948128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577dcd8-d827-4e1b-86aa-07ce4e4c076b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:46.949235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:46.950055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577dcd8-d827-4e1b-86aa-07ce4e4c076b None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.950055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577dcd8-d827-4e1b-86aa-07ce4e4c076b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.950338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577dcd8-d827-4e1b-86aa-07ce4e4c076b None admin] PATH_INFO: `/v3/groups` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.951053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577dcd8-d827-4e1b-86aa-07ce4e4c076b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:46.953271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577dcd8-d827-4e1b-86aa-07ce4e4c076b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:46.970366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 162/324] 10.222.0.48 () {60 vars in 1134 bytes} [Thu Jul 21 04:04:46 2022] POST /identity/v3/groups => generated 226 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:04:46.984074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbaebe-5ceb-4195-ba3c-4802748cb7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:46.984895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbaebe-5ceb-4195-ba3c-4802748cb7d6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:46.985177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbaebe-5ceb-4195-ba3c-4802748cb7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:46.985449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dbaebe-5ceb-4195-ba3c-4802748cb7d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:46.998742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dbaebe-5ceb-4195-ba3c-4802748cb7d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-30dbaebe-5ceb-4195-ba3c-4802748cb7d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:47.007362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:47.008356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:47.014641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 163/325] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:47.015362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577dcd8-d827-4e1b-86aa-07ce4e4c076b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.126126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577dcd8-d827-4e1b-86aa-07ce4e4c076b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.161151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ce31ce-bd09-450c-a53f-df40f9d3f26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.161885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce31ce-bd09-450c-a53f-df40f9d3f26b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.162164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce31ce-bd09-450c-a53f-df40f9d3f26b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.162435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ce31ce-bd09-450c-a53f-df40f9d3f26b None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.163306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce31ce-bd09-450c-a53f-df40f9d3f26b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:47.163609 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce31ce-bd09-450c-a53f-df40f9d3f26b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:47.165000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ce31ce-bd09-450c-a53f-df40f9d3f26b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:47.173577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 163/326] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:47.181835 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbaebe-5ceb-4195-ba3c-4802748cb7d6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.285438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f75e78-db99-40ce-8f64-75c946822c57 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.285759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f75e78-db99-40ce-8f64-75c946822c57 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.286042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f75e78-db99-40ce-8f64-75c946822c57 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.290979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 164/327] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:47.294377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314ebf-1ca3-4663-9aa5-2a749ef0a847 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.294672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314ebf-1ca3-4663-9aa5-2a749ef0a847 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.296415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47314ebf-1ca3-4663-9aa5-2a749ef0a847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.303386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:47.309191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dbaebe-5ceb-4195-ba3c-4802748cb7d6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.319875 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-47314ebf-1ca3-4663-9aa5-2a749ef0a847 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:47.321088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-47314ebf-1ca3-4663-9aa5-2a749ef0a847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:47.351486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7e38-7255-47ba-befc-3a643a742909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.352374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7e38-7255-47ba-befc-3a643a742909 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.352660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7e38-7255-47ba-befc-3a643a742909 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.353024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682e7e38-7255-47ba-befc-3a643a742909 None admin] PATH_INFO: `/v3/users/c8da16de56bf435e9a45486da3f5525d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.356577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e7e38-7255-47ba-befc-3a643a742909 None admin] RBAC: Authorizing `identity:get_user(user_id=c8da16de56bf435e9a45486da3f5525d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:47.356938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682e7e38-7255-47ba-befc-3a643a742909 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:47.359458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 164/328] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/users/c8da16de56bf435e9a45486da3f5525d => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:47.365145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7e38-7255-47ba-befc-3a643a742909 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.402157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:47.421244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 165/329] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:47.446608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47314ebf-1ca3-4663-9aa5-2a749ef0a847 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.487400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682e7e38-7255-47ba-befc-3a643a742909 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.527141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9414f8-998b-4ed0-a5d4-f1987497c320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.528019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9414f8-998b-4ed0-a5d4-f1987497c320 None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.528479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9414f8-998b-4ed0-a5d4-f1987497c320 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.528762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9414f8-998b-4ed0-a5d4-f1987497c320 None admin] PATH_INFO: `/v3/system/users/c8da16de56bf435e9a45486da3f5525d/roles/7103b531aa6246d7b44730f73395761f` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.531155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9414f8-998b-4ed0-a5d4-f1987497c320 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c8da16de56bf435e9a45486da3f5525d, role_id=7103b531aa6246d7b44730f73395761f)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:47.532720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9414f8-998b-4ed0-a5d4-f1987497c320 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:47.546393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 165/330] 10.222.0.48 () {58 vars in 1334 bytes} [Thu Jul 21 04:04:47 2022] PUT /identity/v3/system/users/c8da16de56bf435e9a45486da3f5525d/roles/7103b531aa6246d7b44730f73395761f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:04:47.574197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47314ebf-1ca3-4663-9aa5-2a749ef0a847 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.614871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33475-b33d-4bc9-895d-a4029c1b45cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.615756 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33475-b33d-4bc9-895d-a4029c1b45cc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.616039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33475-b33d-4bc9-895d-a4029c1b45cc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.616315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc33475-b33d-4bc9-895d-a4029c1b45cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.618451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:47.634039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc33475-b33d-4bc9-895d-a4029c1b45cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-3bc33475-b33d-4bc9-895d-a4029c1b45cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:47.642476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:47.643495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:47.644283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 166/331] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:47.651180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9414f8-998b-4ed0-a5d4-f1987497c320 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.761087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:47.765230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9414f8-998b-4ed0-a5d4-f1987497c320 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.802867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49ac6-36d7-4be3-9e14-a5d32e5f138e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.803581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49ac6-36d7-4be3-9e14-a5d32e5f138e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.803866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49ac6-36d7-4be3-9e14-a5d32e5f138e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.804145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf49ac6-36d7-4be3-9e14-a5d32e5f138e None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.804972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49ac6-36d7-4be3-9e14-a5d32e5f138e None admin] RBAC: Adding query filter params (name=member) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:47.805286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49ac6-36d7-4be3-9e14-a5d32e5f138e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:47.806713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf49ac6-36d7-4be3-9e14-a5d32e5f138e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:47.816226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 166/332] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:47.821890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33475-b33d-4bc9-895d-a4029c1b45cc None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:47.933016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc33475-b33d-4bc9-895d-a4029c1b45cc None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:47.977408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac556eb-c3a8-4c9f-a579-2f517d5ddaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:47.978353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac556eb-c3a8-4c9f-a579-2f517d5ddaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:47.978644 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac556eb-c3a8-4c9f-a579-2f517d5ddaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:47.978923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac556eb-c3a8-4c9f-a579-2f517d5ddaa8 None admin] PATH_INFO: `/v3/users/b098546ad1c94791bba215d7aa55cbda` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:47.980244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac556eb-c3a8-4c9f-a579-2f517d5ddaa8 None admin] RBAC: Authorizing `identity:get_user(user_id=b098546ad1c94791bba215d7aa55cbda)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:47.981719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac556eb-c3a8-4c9f-a579-2f517d5ddaa8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:47.987036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 167/333] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/users/b098546ad1c94791bba215d7aa55cbda => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:47.993635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49ac6-36d7-4be3-9e14-a5d32e5f138e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:48.118854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf49ac6-36d7-4be3-9e14-a5d32e5f138e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:48.163624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca841d4-d86e-43d4-a5e8-4a8b7dc5cee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:48.164290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca841d4-d86e-43d4-a5e8-4a8b7dc5cee0 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:48.164577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca841d4-d86e-43d4-a5e8-4a8b7dc5cee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:48.164836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca841d4-d86e-43d4-a5e8-4a8b7dc5cee0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:48.165687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca841d4-d86e-43d4-a5e8-4a8b7dc5cee0 None admin] RBAC: Adding query filter params (role.id=49806c1799404d039cb4e2a11f1d4442, user.id=b098546ad1c94791bba215d7aa55cbda, scope.system=all) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:48.166004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca841d4-d86e-43d4-a5e8-4a8b7dc5cee0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:48.167523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca841d4-d86e-43d4-a5e8-4a8b7dc5cee0 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:48.190736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 167/334] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jul 21 04:04:47 2022] GET /identity/v3/role_assignments?user.id=b098546ad1c94791bba215d7aa55cbda&scope.system=all&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:49.902780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032bd14-085a-4224-a008-967e34ddd414 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.903506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032bd14-085a-4224-a008-967e34ddd414 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.903506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032bd14-085a-4224-a008-967e34ddd414 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.904885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 168/335] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:49.911124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0799a9-e83d-42fc-a466-42d30adc4ba1 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:49.911124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0799a9-e83d-42fc-a466-42d30adc4ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:49.911124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0799a9-e83d-42fc-a466-42d30adc4ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:49.935967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ba0799a9-e83d-42fc-a466-42d30adc4ba1 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:49.937192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ba0799a9-e83d-42fc-a466-42d30adc4ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:49.951467 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.019918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 168/336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:50.067627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032bd14-085a-4224-a008-967e34ddd414 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.138164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.195524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032bd14-085a-4224-a008-967e34ddd414 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.247882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f6784c-b7c6-41c3-a0ec-9ffc428c6d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.248686 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6784c-b7c6-41c3-a0ec-9ffc428c6d04 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.248973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6784c-b7c6-41c3-a0ec-9ffc428c6d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.249255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f6784c-b7c6-41c3-a0ec-9ffc428c6d04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.261910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f6784c-b7c6-41c3-a0ec-9ffc428c6d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f9f6784c-b7c6-41c3-a0ec-9ffc428c6d04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:50.270622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:50.272805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:50.274701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 169/337] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:50.280868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0799a9-e83d-42fc-a466-42d30adc4ba1 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.370187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20072163-833c-440d-930a-47a666b954cc None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.370850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20072163-833c-440d-930a-47a666b954cc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.371411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20072163-833c-440d-930a-47a666b954cc None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.373025 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 170/338] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:50.390856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798981-1bf7-4b14-b04a-1fc375b9f91f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.391801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798981-1bf7-4b14-b04a-1fc375b9f91f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.392621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63798981-1bf7-4b14-b04a-1fc375b9f91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.415476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0799a9-e83d-42fc-a466-42d30adc4ba1 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.431801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-63798981-1bf7-4b14-b04a-1fc375b9f91f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:50.439061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-63798981-1bf7-4b14-b04a-1fc375b9f91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:50.515677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc324097-e979-4caf-ba95-a893e06117f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.516689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc324097-e979-4caf-ba95-a893e06117f5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.517161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc324097-e979-4caf-ba95-a893e06117f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.517614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc324097-e979-4caf-ba95-a893e06117f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.518548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc324097-e979-4caf-ba95-a893e06117f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:50.519069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc324097-e979-4caf-ba95-a893e06117f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.521257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc324097-e979-4caf-ba95-a893e06117f5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:50.539815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 169/339] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:50.545172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc324097-e979-4caf-ba95-a893e06117f5 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.547591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 171/340] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:50.577592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.584510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798981-1bf7-4b14-b04a-1fc375b9f91f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.723547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:50.732458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63798981-1bf7-4b14-b04a-1fc375b9f91f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.765268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc324097-e979-4caf-ba95-a893e06117f5 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:50.783604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4874baf-ffd5-4ae0-9e98-30b44ede912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.784420 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4874baf-ffd5-4ae0-9e98-30b44ede912d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.784967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4874baf-ffd5-4ae0-9e98-30b44ede912d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.785984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4874baf-ffd5-4ae0-9e98-30b44ede912d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.811973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4874baf-ffd5-4ae0-9e98-30b44ede912d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-d4874baf-ffd5-4ae0-9e98-30b44ede912d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:50.831291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:50.833004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:50.833997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:50.844259 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 172/341] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:50.849876 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b68eb-9601-4df3-bee1-966aafc17f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:50.850727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b68eb-9601-4df3-bee1-966aafc17f7f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:50.851181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b68eb-9601-4df3-bee1-966aafc17f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:50.851605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b68eb-9601-4df3-bee1-966aafc17f7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:50.858347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4874baf-ffd5-4ae0-9e98-30b44ede912d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:50.981810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b68eb-9601-4df3-bee1-966aafc17f7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:50.983283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939b68eb-9601-4df3-bee1-966aafc17f7f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:51.011326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:51.026230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4874baf-ffd5-4ae0-9e98-30b44ede912d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:51.056465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:51.079276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4597c0-5372-4a88-9cdd-15f5df221fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:51.079957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4597c0-5372-4a88-9cdd-15f5df221fcf None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.080245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4597c0-5372-4a88-9cdd-15f5df221fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.080527 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4597c0-5372-4a88-9cdd-15f5df221fcf None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.081291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4597c0-5372-4a88-9cdd-15f5df221fcf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:51.081615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4597c0-5372-4a88-9cdd-15f5df221fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:51.083126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4597c0-5372-4a88-9cdd-15f5df221fcf None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:51.095989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 173/342] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:51.102006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4597c0-5372-4a88-9cdd-15f5df221fcf None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:51.152394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 170/343] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:04:51.158176 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b68eb-9601-4df3-bee1-966aafc17f7f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:51.247879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4597c0-5372-4a88-9cdd-15f5df221fcf None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:51.303528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785cdfb3-4867-448d-a6fd-3c42cd0624b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:51.304421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cdfb3-4867-448d-a6fd-3c42cd0624b9 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.304885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cdfb3-4867-448d-a6fd-3c42cd0624b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.305307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785cdfb3-4867-448d-a6fd-3c42cd0624b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.309804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b68eb-9601-4df3-bee1-966aafc17f7f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:51.323322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:51.348984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ae09c-9ee1-4aea-9755-4baa17d9e026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:51.349855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ae09c-9ee1-4aea-9755-4baa17d9e026 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.350140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ae09c-9ee1-4aea-9755-4baa17d9e026 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.350417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ae09c-9ee1-4aea-9755-4baa17d9e026 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.351717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ae09c-9ee1-4aea-9755-4baa17d9e026 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:51.353194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429ae09c-9ee1-4aea-9755-4baa17d9e026 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:51.355265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 171/344] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:51 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:51.356939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264c37e-641f-43db-98c5-0913cba952fc None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.357071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264c37e-641f-43db-98c5-0913cba952fc None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.357310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264c37e-641f-43db-98c5-0913cba952fc None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.358578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 172/345] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:51.359708 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ee8c9-969e-433c-be93-0d8a1786fac1 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.359999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ee8c9-969e-433c-be93-0d8a1786fac1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.360282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ee8c9-969e-433c-be93-0d8a1786fac1 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.361522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 173/346] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:51.365166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ee8c9-969e-433c-be93-0d8a1786fac1 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:51.368102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:51.411188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cdfb3-4867-448d-a6fd-3c42cd0624b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:51.412684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785cdfb3-4867-448d-a6fd-3c42cd0624b9 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:51.503844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ee8c9-969e-433c-be93-0d8a1786fac1 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:51.529758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 174/347] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:04:51.534427 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6cf14-7a4e-41d4-9356-d8c455b5c44f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.534922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6cf14-7a4e-41d4-9356-d8c455b5c44f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.536600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6cf14-7a4e-41d4-9356-d8c455b5c44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.545575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9684c2-bfd1-4555-b2e1-3da3fb6cb096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:51.546771 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9684c2-bfd1-4555-b2e1-3da3fb6cb096 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.547145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9684c2-bfd1-4555-b2e1-3da3fb6cb096 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.547423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9684c2-bfd1-4555-b2e1-3da3fb6cb096 None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.554065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e9a6cf14-7a4e-41d4-9356-d8c455b5c44f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:51.555279 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e9a6cf14-7a4e-41d4-9356-d8c455b5c44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:51.558914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9684c2-bfd1-4555-b2e1-3da3fb6cb096 None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:51.560425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9684c2-bfd1-4555-b2e1-3da3fb6cb096 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:51.562299 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 174/348] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:51 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:51.563380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b5a7-d548-4c6e-8ded-122d65f469fd None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.563666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b5a7-d548-4c6e-8ded-122d65f469fd None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.563938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c14b5a7-d548-4c6e-8ded-122d65f469fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.582632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-0c14b5a7-d548-4c6e-8ded-122d65f469fd None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:51.583887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0c14b5a7-d548-4c6e-8ded-122d65f469fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:51.627287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:51.634079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 175/349] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:51.635516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa10131-94e1-4d79-9290-be6d9e655068 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.635793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa10131-94e1-4d79-9290-be6d9e655068 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.636069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa10131-94e1-4d79-9290-be6d9e655068 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.637491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 176/350] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:51.638399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee9a98-accc-42f2-8a42-b7d780daaaa1 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.638681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee9a98-accc-42f2-8a42-b7d780daaaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.639055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee9a98-accc-42f2-8a42-b7d780daaaa1 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.644277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 177/351] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:51.644911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee9a98-accc-42f2-8a42-b7d780daaaa1 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:51.650444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:51.670040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 175/352] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:51.671191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b5a7-d548-4c6e-8ded-122d65f469fd None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:51.763522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee9a98-accc-42f2-8a42-b7d780daaaa1 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:51.796272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c14b5a7-d548-4c6e-8ded-122d65f469fd None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:51.803700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8b9a2-cb64-4b61-ac91-8b232511a7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:51.804580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b9a2-cb64-4b61-ac91-8b232511a7fc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.804869 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b9a2-cb64-4b61-ac91-8b232511a7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.805147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b9a2-cb64-4b61-ac91-8b232511a7fc None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.806357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8b9a2-cb64-4b61-ac91-8b232511a7fc None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:51.807923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8b9a2-cb64-4b61-ac91-8b232511a7fc None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:51.809821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 178/353] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:51 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:51.811076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83741b5-1b62-4c6b-971a-99e7a4389c52 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.811366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83741b5-1b62-4c6b-971a-99e7a4389c52 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.811647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83741b5-1b62-4c6b-971a-99e7a4389c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.832945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d83741b5-1b62-4c6b-971a-99e7a4389c52 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:51.834160 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d83741b5-1b62-4c6b-971a-99e7a4389c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:51.841265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287da309-c6b0-4f9d-9025-b406caf705e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:51.841926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287da309-c6b0-4f9d-9025-b406caf705e4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.842209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287da309-c6b0-4f9d-9025-b406caf705e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.842727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287da309-c6b0-4f9d-9025-b406caf705e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.843344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287da309-c6b0-4f9d-9025-b406caf705e4 None admin] RBAC: Adding query filter params (group.id=4ca0321da0934822a42256e0e18c6aae, role.id=49806c1799404d039cb4e2a11f1d4442, scope.project.id=6a4c69c73a874668837daa9a9951b335) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:51.843692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287da309-c6b0-4f9d-9025-b406caf705e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:51.845164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287da309-c6b0-4f9d-9025-b406caf705e4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:51.854029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 176/354] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 21 04:04:51 2022] GET /identity/v3/role_assignments?group.id=4ca0321da0934822a42256e0e18c6aae&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:51.855324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb423f0e-e00f-4dde-b4f2-d5ef48812bef None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:51.855618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb423f0e-e00f-4dde-b4f2-d5ef48812bef None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:51.855899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb423f0e-e00f-4dde-b4f2-d5ef48812bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:51.878705 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fb423f0e-e00f-4dde-b4f2-d5ef48812bef None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:51.880046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fb423f0e-e00f-4dde-b4f2-d5ef48812bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:51.917924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:51.930615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 179/355] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:51.931376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83741b5-1b62-4c6b-971a-99e7a4389c52 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:51.934158 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:51.975069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 177/356] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:51.975949 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb423f0e-e00f-4dde-b4f2-d5ef48812bef None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.064622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83741b5-1b62-4c6b-971a-99e7a4389c52 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.115751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27cd67-015a-4539-97a3-dd91c82e7f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.117141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27cd67-015a-4539-97a3-dd91c82e7f57 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.117141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27cd67-015a-4539-97a3-dd91c82e7f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.117411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27cd67-015a-4539-97a3-dd91c82e7f57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.133085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf27cd67-015a-4539-97a3-dd91c82e7f57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:52.133272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb423f0e-e00f-4dde-b4f2-d5ef48812bef None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-cf27cd67-015a-4539-97a3-dd91c82e7f57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:52.142853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:52.143894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:52.144739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 180/357] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:52.146165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27cd67-015a-4539-97a3-dd91c82e7f57 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.188370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03546cc-3c31-45d8-bcd6-bab1bbea2fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.189189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03546cc-3c31-45d8-bcd6-bab1bbea2fcf None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.189477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03546cc-3c31-45d8-bcd6-bab1bbea2fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.189753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03546cc-3c31-45d8-bcd6-bab1bbea2fcf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.205338 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03546cc-3c31-45d8-bcd6-bab1bbea2fcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-d03546cc-3c31-45d8-bcd6-bab1bbea2fcf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:52.213857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:52.214764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:52.215611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 178/358] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:52.216291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03546cc-3c31-45d8-bcd6-bab1bbea2fcf None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.241692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.253625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.291389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27cd67-015a-4539-97a3-dd91c82e7f57 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.337206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82013d4-e7c7-420d-ac1f-f7a59cb44216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.338238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82013d4-e7c7-420d-ac1f-f7a59cb44216 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.338519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82013d4-e7c7-420d-ac1f-f7a59cb44216 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.338796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82013d4-e7c7-420d-ac1f-f7a59cb44216 None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.340059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82013d4-e7c7-420d-ac1f-f7a59cb44216 None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:52.341531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82013d4-e7c7-420d-ac1f-f7a59cb44216 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:52.343197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 181/359] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:52.343956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82013d4-e7c7-420d-ac1f-f7a59cb44216 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.345894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03546cc-3c31-45d8-bcd6-bab1bbea2fcf None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.395813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16367-c41e-4799-bb0f-3ae1757a8b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.397006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16367-c41e-4799-bb0f-3ae1757a8b5b None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.397497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16367-c41e-4799-bb0f-3ae1757a8b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.397974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e16367-c41e-4799-bb0f-3ae1757a8b5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.412821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e16367-c41e-4799-bb0f-3ae1757a8b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-78e16367-c41e-4799-bb0f-3ae1757a8b5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:52.424055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:52.425087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 179/360] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:52.426491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16367-c41e-4799-bb0f-3ae1757a8b5b None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.498919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82013d4-e7c7-420d-ac1f-f7a59cb44216 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.539277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.543693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.546634 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf78df6-d9a3-4bcb-8883-4fa196ba21c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.547687 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf78df6-d9a3-4bcb-8883-4fa196ba21c5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.548149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf78df6-d9a3-4bcb-8883-4fa196ba21c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.548624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf78df6-d9a3-4bcb-8883-4fa196ba21c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.563841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf78df6-d9a3-4bcb-8883-4fa196ba21c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:52.572435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e16367-c41e-4799-bb0f-3ae1757a8b5b None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-edf78df6-d9a3-4bcb-8883-4fa196ba21c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:52.572884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:52.573767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:52.574547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 182/361] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:52.575236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf78df6-d9a3-4bcb-8883-4fa196ba21c5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.630241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934aebbb-ec02-4ab0-a145-03cbd7330e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.631300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934aebbb-ec02-4ab0-a145-03cbd7330e70 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.631797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934aebbb-ec02-4ab0-a145-03cbd7330e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.632079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934aebbb-ec02-4ab0-a145-03cbd7330e70 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.632843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934aebbb-ec02-4ab0-a145-03cbd7330e70 None admin] RBAC: Adding query filter params (name=member) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:52.633157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934aebbb-ec02-4ab0-a145-03cbd7330e70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:52.634582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934aebbb-ec02-4ab0-a145-03cbd7330e70 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:52.646730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 180/362] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:52.647466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934aebbb-ec02-4ab0-a145-03cbd7330e70 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.703477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf78df6-d9a3-4bcb-8883-4fa196ba21c5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.751680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df754766-f015-46ec-9b09-846f1c9b0ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.752607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754766-f015-46ec-9b09-846f1c9b0ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.755118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754766-f015-46ec-9b09-846f1c9b0ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.755118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df754766-f015-46ec-9b09-846f1c9b0ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.755118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df754766-f015-46ec-9b09-846f1c9b0ae2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:52.755118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df754766-f015-46ec-9b09-846f1c9b0ae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:52.756522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df754766-f015-46ec-9b09-846f1c9b0ae2 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:52.766296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 183/363] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:52.770552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df754766-f015-46ec-9b09-846f1c9b0ae2 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.782533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934aebbb-ec02-4ab0-a145-03cbd7330e70 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.829191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab2763-a509-41ae-b506-20b200bcebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.830024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab2763-a509-41ae-b506-20b200bcebcd None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.830364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab2763-a509-41ae-b506-20b200bcebcd None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.833605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ab2763-a509-41ae-b506-20b200bcebcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.834463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab2763-a509-41ae-b506-20b200bcebcd None admin] RBAC: Adding query filter params (group.id=4ca0321da0934822a42256e0e18c6aae, role.id=b29b8d5f31b44d8b90eb10c34acbc06a, scope.project.id=6a4c69c73a874668837daa9a9951b335) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:52.834778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab2763-a509-41ae-b506-20b200bcebcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:52.836329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ab2763-a509-41ae-b506-20b200bcebcd None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:52.848444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 181/364] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/role_assignments?group.id=4ca0321da0934822a42256e0e18c6aae&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=b29b8d5f31b44d8b90eb10c34acbc06a => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:52.848444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab2763-a509-41ae-b506-20b200bcebcd None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:52.849324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.869603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:52.924985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df754766-f015-46ec-9b09-846f1c9b0ae2 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.977918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17269-e674-4861-8e94-4dd3d5226f2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:52.980049 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17269-e674-4861-8e94-4dd3d5226f2f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:52.980440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17269-e674-4861-8e94-4dd3d5226f2f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:52.981352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f17269-e674-4861-8e94-4dd3d5226f2f None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:52.982763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f17269-e674-4861-8e94-4dd3d5226f2f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:52.983209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f17269-e674-4861-8e94-4dd3d5226f2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:52.985554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f17269-e674-4861-8e94-4dd3d5226f2f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:52.988976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ab2763-a509-41ae-b506-20b200bcebcd None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:52.998382 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 184/365] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:52.999434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17269-e674-4861-8e94-4dd3d5226f2f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.037304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c129fdb-908a-49cd-b2de-fd3a203e399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.038566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c129fdb-908a-49cd-b2de-fd3a203e399a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.039076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c129fdb-908a-49cd-b2de-fd3a203e399a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.039709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c129fdb-908a-49cd-b2de-fd3a203e399a None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.041085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c129fdb-908a-49cd-b2de-fd3a203e399a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:53.041717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c129fdb-908a-49cd-b2de-fd3a203e399a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.043944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c129fdb-908a-49cd-b2de-fd3a203e399a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.057823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 182/366] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:53.059596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c129fdb-908a-49cd-b2de-fd3a203e399a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.139348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f17269-e674-4861-8e94-4dd3d5226f2f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.160023 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.166867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.188949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6361-9d0f-4be3-b561-f47dc314caa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.188949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6361-9d0f-4be3-b561-f47dc314caa6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.188949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6361-9d0f-4be3-b561-f47dc314caa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.188949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d6361-9d0f-4be3-b561-f47dc314caa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.212447 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c129fdb-908a-49cd-b2de-fd3a203e399a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.254925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14edda-ab54-49f0-8587-74f412dfe5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.256032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14edda-ab54-49f0-8587-74f412dfe5b4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.256321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14edda-ab54-49f0-8587-74f412dfe5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.256600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14edda-ab54-49f0-8587-74f412dfe5b4 None admin] PATH_INFO: `/v3/users/c8da16de56bf435e9a45486da3f5525d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.257829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14edda-ab54-49f0-8587-74f412dfe5b4 None admin] RBAC: Authorizing `identity:get_user(user_id=c8da16de56bf435e9a45486da3f5525d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.259323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14edda-ab54-49f0-8587-74f412dfe5b4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.260971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 183/367] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/users/c8da16de56bf435e9a45486da3f5525d => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:53.261737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14edda-ab54-49f0-8587-74f412dfe5b4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.290452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d6361-9d0f-4be3-b561-f47dc314caa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.292168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d6361-9d0f-4be3-b561-f47dc314caa6 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.366746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14edda-ab54-49f0-8587-74f412dfe5b4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.403246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdc871-a3d3-49f4-9e14-e2c5874b9f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.403586 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 185/368] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:53.403899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdc871-a3d3-49f4-9e14-e2c5874b9f7d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.404185 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdc871-a3d3-49f4-9e14-e2c5874b9f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.404461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afdc871-a3d3-49f4-9e14-e2c5874b9f7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.404569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6361-9d0f-4be3-b561-f47dc314caa6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.417681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.423044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.485279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdc871-a3d3-49f4-9e14-e2c5874b9f7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.486674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afdc871-a3d3-49f4-9e14-e2c5874b9f7d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.526600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d6361-9d0f-4be3-b561-f47dc314caa6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.562487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5882093-7474-480e-826f-b0d33ef91d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.563175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5882093-7474-480e-826f-b0d33ef91d07 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.563516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5882093-7474-480e-826f-b0d33ef91d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.563796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5882093-7474-480e-826f-b0d33ef91d07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.593063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 184/369] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:53.594064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdc871-a3d3-49f4-9e14-e2c5874b9f7d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.640978 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5882093-7474-480e-826f-b0d33ef91d07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.642005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.642827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5882093-7474-480e-826f-b0d33ef91d07 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.659089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.705126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afdc871-a3d3-49f4-9e14-e2c5874b9f7d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.742370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c2729-2299-4431-8b60-ef2c73000c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.743033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c2729-2299-4431-8b60-ef2c73000c26 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.743322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c2729-2299-4431-8b60-ef2c73000c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.743599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c2729-2299-4431-8b60-ef2c73000c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.744442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c2729-2299-4431-8b60-ef2c73000c26 None admin] RBAC: Adding query filter params (role.id=7103b531aa6246d7b44730f73395761f, user.id=c8da16de56bf435e9a45486da3f5525d, scope.system=all) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:53.744753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c2729-2299-4431-8b60-ef2c73000c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.746199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c2729-2299-4431-8b60-ef2c73000c26 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.753650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 186/370] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:04:53.755186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5882093-7474-480e-826f-b0d33ef91d07 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.759900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 185/371] 10.222.0.48 () {56 vars in 1308 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/role_assignments?user.id=c8da16de56bf435e9a45486da3f5525d&scope.system=all&role.id=7103b531aa6246d7b44730f73395761f => generated 510 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:53.760726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c2729-2299-4431-8b60-ef2c73000c26 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.868172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5882093-7474-480e-826f-b0d33ef91d07 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.869665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.873697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c2729-2299-4431-8b60-ef2c73000c26 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:53.884832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:53.909421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65979a0-0ccf-46af-b794-d30900e95131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.910484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65979a0-0ccf-46af-b794-d30900e95131 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.911044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65979a0-0ccf-46af-b794-d30900e95131 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.911332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65979a0-0ccf-46af-b794-d30900e95131 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.911981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227ef9-47ef-42ef-810b-9669c21b9b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:53.912605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65979a0-0ccf-46af-b794-d30900e95131 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.912862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227ef9-47ef-42ef-810b-9669c21b9b51 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:53.913145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227ef9-47ef-42ef-810b-9669c21b9b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:53.913422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227ef9-47ef-42ef-810b-9669c21b9b51 None admin] PATH_INFO: `/v3/projects/39bed1c15cc5411994e7f051730f1155` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:53.914174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65979a0-0ccf-46af-b794-d30900e95131 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.914685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227ef9-47ef-42ef-810b-9669c21b9b51 None admin] RBAC: Authorizing `identity:get_project(project_id=39bed1c15cc5411994e7f051730f1155)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:53.916212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227ef9-47ef-42ef-810b-9669c21b9b51 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:53.916425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 187/372] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:53.917247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65979a0-0ccf-46af-b794-d30900e95131 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:53.918104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 186/373] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/projects/39bed1c15cc5411994e7f051730f1155 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:53.928260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227ef9-47ef-42ef-810b-9669c21b9b51 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.049316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227ef9-47ef-42ef-810b-9669c21b9b51 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.078350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65979a0-0ccf-46af-b794-d30900e95131 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.085724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50448-aa51-4318-b6b9-9ecc00c07696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.086604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50448-aa51-4318-b6b9-9ecc00c07696 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.086888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50448-aa51-4318-b6b9-9ecc00c07696 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.087215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f50448-aa51-4318-b6b9-9ecc00c07696 None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.088685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f50448-aa51-4318-b6b9-9ecc00c07696 None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.090173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f50448-aa51-4318-b6b9-9ecc00c07696 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.092165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 187/374] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:54.092942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50448-aa51-4318-b6b9-9ecc00c07696 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.127819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9166ab-c934-43dd-aa9c-66ba87aa806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.130161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9166ab-c934-43dd-aa9c-66ba87aa806a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.130446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9166ab-c934-43dd-aa9c-66ba87aa806a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.130723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9166ab-c934-43dd-aa9c-66ba87aa806a None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.132014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9166ab-c934-43dd-aa9c-66ba87aa806a None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.133501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9166ab-c934-43dd-aa9c-66ba87aa806a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.135680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 188/375] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:53 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:54.136586 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9166ab-c934-43dd-aa9c-66ba87aa806a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.152165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:54.201376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:54.234196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f50448-aa51-4318-b6b9-9ecc00c07696 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.277019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9166ab-c934-43dd-aa9c-66ba87aa806a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.283813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc84d7-e82d-4f81-b724-e4b7d71571c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.284707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc84d7-e82d-4f81-b724-e4b7d71571c7 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.285064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc84d7-e82d-4f81-b724-e4b7d71571c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.285362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cc84d7-e82d-4f81-b724-e4b7d71571c7 None admin] PATH_INFO: `/v3/groups/ad3465abebd444dea05fdd65dce9ebe3` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.292457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc84d7-e82d-4f81-b724-e4b7d71571c7 None admin] RBAC: Authorizing `identity:get_group(group_id=ad3465abebd444dea05fdd65dce9ebe3)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.293947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cc84d7-e82d-4f81-b724-e4b7d71571c7 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.295754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 188/376] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:54 2022] GET /identity/v3/groups/ad3465abebd444dea05fdd65dce9ebe3 => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:54.296535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc84d7-e82d-4f81-b724-e4b7d71571c7 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.327039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460e20d2-e495-42d9-a94c-d7fdfb3435aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.327624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e20d2-e495-42d9-a94c-d7fdfb3435aa None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.327969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e20d2-e495-42d9-a94c-d7fdfb3435aa None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.328251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460e20d2-e495-42d9-a94c-d7fdfb3435aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.329148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e20d2-e495-42d9-a94c-d7fdfb3435aa None admin] RBAC: Adding query filter params (group.id=4ca0321da0934822a42256e0e18c6aae, role.id=49806c1799404d039cb4e2a11f1d4442, scope.project.id=91700d043c204f948188f50578e3abdc) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:54.329430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e20d2-e495-42d9-a94c-d7fdfb3435aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.330876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460e20d2-e495-42d9-a94c-d7fdfb3435aa None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.340949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 189/377] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 21 04:04:54 2022] GET /identity/v3/role_assignments?group.id=4ca0321da0934822a42256e0e18c6aae&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:54.344104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b69a20-3997-47b6-baa4-dd972d2fe305 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.344662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b69a20-3997-47b6-baa4-dd972d2fe305 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.345480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b69a20-3997-47b6-baa4-dd972d2fe305 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.348517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 190/378] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:54.350159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b69a20-3997-47b6-baa4-dd972d2fe305 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.422184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:54.430524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cc84d7-e82d-4f81-b724-e4b7d71571c7 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.497268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b4041-3a11-4bd3-926d-934bde01bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.498216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b4041-3a11-4bd3-926d-934bde01bc9e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.498501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b4041-3a11-4bd3-926d-934bde01bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.498779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b4041-3a11-4bd3-926d-934bde01bc9e None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.501090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b4041-3a11-4bd3-926d-934bde01bc9e None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.501478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b69a20-3997-47b6-baa4-dd972d2fe305 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.502571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b4041-3a11-4bd3-926d-934bde01bc9e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.505152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 189/379] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:54 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:54.506176 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddc7e6-d46f-4698-8f70-9385fd6966be None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.506464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddc7e6-d46f-4698-8f70-9385fd6966be None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.507085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddc7e6-d46f-4698-8f70-9385fd6966be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.520437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:54.527991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-f6ddc7e6-d46f-4698-8f70-9385fd6966be None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:54.529981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f6ddc7e6-d46f-4698-8f70-9385fd6966be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:54.543735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495c91d-1314-452d-b3d5-b4535667ec35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.544392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495c91d-1314-452d-b3d5-b4535667ec35 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.544673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495c91d-1314-452d-b3d5-b4535667ec35 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.544944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e495c91d-1314-452d-b3d5-b4535667ec35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.545777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495c91d-1314-452d-b3d5-b4535667ec35 None admin] RBAC: Adding query filter params (group.id=ad3465abebd444dea05fdd65dce9ebe3, role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=39bed1c15cc5411994e7f051730f1155) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:54.546092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495c91d-1314-452d-b3d5-b4535667ec35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.547567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e495c91d-1314-452d-b3d5-b4535667ec35 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.554317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 191/380] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 21 04:04:54 2022] GET /identity/v3/role_assignments?group.id=ad3465abebd444dea05fdd65dce9ebe3&scope.project.id=39bed1c15cc5411994e7f051730f1155&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:54.554864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495c91d-1314-452d-b3d5-b4535667ec35 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.680924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e495c91d-1314-452d-b3d5-b4535667ec35 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.685381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 190/381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:54.719384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaa30f-a816-485a-8447-86f696f1aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.719953 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddc7e6-d46f-4698-8f70-9385fd6966be None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:54.720076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa30f-a816-485a-8447-86f696f1aea3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.720318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa30f-a816-485a-8447-86f696f1aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.720594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaa30f-a816-485a-8447-86f696f1aea3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.721435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaa30f-a816-485a-8447-86f696f1aea3 None admin] RBAC: Adding query filter params (group.id=4ca0321da0934822a42256e0e18c6aae, role.id=b29b8d5f31b44d8b90eb10c34acbc06a, scope.project.id=91700d043c204f948188f50578e3abdc) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:54.721748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaa30f-a816-485a-8447-86f696f1aea3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:54.723838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daaa30f-a816-485a-8447-86f696f1aea3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:54.730655 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 192/382] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 21 04:04:54 2022] GET /identity/v3/role_assignments?group.id=4ca0321da0934822a42256e0e18c6aae&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=b29b8d5f31b44d8b90eb10c34acbc06a => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:54.851334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:54.855716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddc7e6-d46f-4698-8f70-9385fd6966be None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:54.907938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a5160-e93b-4ab4-9c6a-83f45b28acab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:54.908748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a5160-e93b-4ab4-9c6a-83f45b28acab None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:54.909028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a5160-e93b-4ab4-9c6a-83f45b28acab None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:54.909302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283a5160-e93b-4ab4-9c6a-83f45b28acab None admin] PATH_INFO: `/v3/roles/member` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:54.924124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283a5160-e93b-4ab4-9c6a-83f45b28acab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-283a5160-e93b-4ab4-9c6a-83f45b28acab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:54.933101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:54.934097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:54.934927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 191/383] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:54.942354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaa30f-a816-485a-8447-86f696f1aea3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.009927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:55.072084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaa30f-a816-485a-8447-86f696f1aea3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:55.110843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3164a3-1811-49c1-a943-2fe11ccfdb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:55.111544 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3164a3-1811-49c1-a943-2fe11ccfdb9c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.111836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3164a3-1811-49c1-a943-2fe11ccfdb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.112112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3164a3-1811-49c1-a943-2fe11ccfdb9c None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.112869 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3164a3-1811-49c1-a943-2fe11ccfdb9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:55.113208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3164a3-1811-49c1-a943-2fe11ccfdb9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:55.115188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3164a3-1811-49c1-a943-2fe11ccfdb9c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:55.126843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 193/384] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:55.132075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a5160-e93b-4ab4-9c6a-83f45b28acab None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.245152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283a5160-e93b-4ab4-9c6a-83f45b28acab None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:55.288615 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1895a0ed-b896-4f05-82d5-03c172053ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:55.289495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895a0ed-b896-4f05-82d5-03c172053ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.289778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895a0ed-b896-4f05-82d5-03c172053ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.290078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1895a0ed-b896-4f05-82d5-03c172053ce5 None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.291300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895a0ed-b896-4f05-82d5-03c172053ce5 None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:55.292781 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1895a0ed-b896-4f05-82d5-03c172053ce5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:55.294583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 192/385] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:55 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:55.299854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3164a3-1811-49c1-a943-2fe11ccfdb9c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.455103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3164a3-1811-49c1-a943-2fe11ccfdb9c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:55.459970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:55.503714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242c72d-e80e-48f2-8dc4-226f25000a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:55.505144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242c72d-e80e-48f2-8dc4-226f25000a27 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.505430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242c72d-e80e-48f2-8dc4-226f25000a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.505707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242c72d-e80e-48f2-8dc4-226f25000a27 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.506910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242c72d-e80e-48f2-8dc4-226f25000a27 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:55.509581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b5e34-d7df-4809-9686-bb7c6569888b None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.509867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b5e34-d7df-4809-9686-bb7c6569888b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.510141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03b5e34-d7df-4809-9686-bb7c6569888b None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.511830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 193/386] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:55.511949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242c72d-e80e-48f2-8dc4-226f25000a27 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:55.513985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 194/387] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:55 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:55.516796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b862d-84a7-4364-86b4-699bd7e7ad86 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.517081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b862d-84a7-4364-86b4-699bd7e7ad86 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.517360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b862d-84a7-4364-86b4-699bd7e7ad86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.519629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242c72d-e80e-48f2-8dc4-226f25000a27 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.538116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fd2b862d-84a7-4364-86b4-699bd7e7ad86 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:55.539326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fd2b862d-84a7-4364-86b4-699bd7e7ad86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:55.563377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:55.617724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 194/388] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:55.641539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b862d-84a7-4364-86b4-699bd7e7ad86 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.756420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b862d-84a7-4364-86b4-699bd7e7ad86 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:55.793542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9b7d-ea8b-4afc-b0d4-2a22d4186f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:55.794348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9b7d-ea8b-4afc-b0d4-2a22d4186f71 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.794628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9b7d-ea8b-4afc-b0d4-2a22d4186f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.794902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b9b7d-ea8b-4afc-b0d4-2a22d4186f71 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.804866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242c72d-e80e-48f2-8dc4-226f25000a27 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:55.806078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b9b7d-ea8b-4afc-b0d4-2a22d4186f71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-3a9b9b7d-ea8b-4afc-b0d4-2a22d4186f71 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:55.815466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:55.816381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:55.817178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 195/389] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:55.823064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9b7d-ea8b-4afc-b0d4-2a22d4186f71 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.843831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:55.924218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb1b9b-2675-4ffc-8a74-11687e548b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:55.925119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1b9b-2675-4ffc-8a74-11687e548b35 None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.925404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1b9b-2675-4ffc-8a74-11687e548b35 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.925730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb1b9b-2675-4ffc-8a74-11687e548b35 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335/groups/4ca0321da0934822a42256e0e18c6aae/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.927856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb1b9b-2675-4ffc-8a74-11687e548b35 None admin] RBAC: Authorizing `identity:create_grant(project_id=6a4c69c73a874668837daa9a9951b335, group_id=4ca0321da0934822a42256e0e18c6aae, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:55.929317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb1b9b-2675-4ffc-8a74-11687e548b35 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:55.930803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b9b7d-ea8b-4afc-b0d4-2a22d4186f71 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:55.967219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a470a8-b2e9-483b-9bd8-847234450358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:55.967914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a470a8-b2e9-483b-9bd8-847234450358 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:55.968203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a470a8-b2e9-483b-9bd8-847234450358 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:55.968481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a470a8-b2e9-483b-9bd8-847234450358 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:55.969260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a470a8-b2e9-483b-9bd8-847234450358 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:55.969572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a470a8-b2e9-483b-9bd8-847234450358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:55.971049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a470a8-b2e9-483b-9bd8-847234450358 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:55.982673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 196/390] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:55.988140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a470a8-b2e9-483b-9bd8-847234450358 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:55.994011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 195/391] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jul 21 04:04:55 2022] PUT /identity/v3/projects/6a4c69c73a874668837daa9a9951b335/groups/4ca0321da0934822a42256e0e18c6aae/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:04:56.075947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:56.099189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a470a8-b2e9-483b-9bd8-847234450358 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:56.136016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35dfc5-1c4e-489e-af2e-1519b33866ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:56.136900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35dfc5-1c4e-489e-af2e-1519b33866ee None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.137182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35dfc5-1c4e-489e-af2e-1519b33866ee None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.137458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35dfc5-1c4e-489e-af2e-1519b33866ee None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.138921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35dfc5-1c4e-489e-af2e-1519b33866ee None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:56.140541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35dfc5-1c4e-489e-af2e-1519b33866ee None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:56.142784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 197/392] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:55 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:56.152151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb1b9b-2675-4ffc-8a74-11687e548b35 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:56.218265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:56.303048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb1b9b-2675-4ffc-8a74-11687e548b35 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:56.344315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1fe03-70c6-46fd-926a-3f97d0935b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:56.345507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1fe03-70c6-46fd-926a-3f97d0935b5c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.346081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1fe03-70c6-46fd-926a-3f97d0935b5c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.346558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1fe03-70c6-46fd-926a-3f97d0935b5c None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.349778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1fe03-70c6-46fd-926a-3f97d0935b5c None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:56.351498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1fe03-70c6-46fd-926a-3f97d0935b5c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:56.353729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 196/393] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:56 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:56.359125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35dfc5-1c4e-489e-af2e-1519b33866ee None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:56.484824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35dfc5-1c4e-489e-af2e-1519b33866ee None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:56.520293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e95a5-b8f6-40ed-a617-f81969926bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:56.521265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e95a5-b8f6-40ed-a617-f81969926bac None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.521550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e95a5-b8f6-40ed-a617-f81969926bac None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.521826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e95a5-b8f6-40ed-a617-f81969926bac None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335/groups/4ca0321da0934822a42256e0e18c6aae/roles/b29b8d5f31b44d8b90eb10c34acbc06a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.524043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e95a5-b8f6-40ed-a617-f81969926bac None admin] RBAC: Authorizing `identity:create_grant(project_id=6a4c69c73a874668837daa9a9951b335, group_id=4ca0321da0934822a42256e0e18c6aae, role_id=b29b8d5f31b44d8b90eb10c34acbc06a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:56.525500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e95a5-b8f6-40ed-a617-f81969926bac None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:56.545538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 198/394] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jul 21 04:04:56 2022] PUT /identity/v3/projects/6a4c69c73a874668837daa9a9951b335/groups/4ca0321da0934822a42256e0e18c6aae/roles/b29b8d5f31b44d8b90eb10c34acbc06a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:56.828813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95ecee-4c9c-4505-9fc3-a70fd80d37f0 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.829094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95ecee-4c9c-4505-9fc3-a70fd80d37f0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.829372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95ecee-4c9c-4505-9fc3-a70fd80d37f0 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.830746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 197/395] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:56.836241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cb3ec-ed8a-49a9-b133-f32182631ab6 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:56.836669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cb3ec-ed8a-49a9-b133-f32182631ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:56.836952 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553cb3ec-ed8a-49a9-b133-f32182631ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:56.849845 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:56.855354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-553cb3ec-ed8a-49a9-b133-f32182631ab6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:56.856536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-553cb3ec-ed8a-49a9-b133-f32182631ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:56.932341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 199/396] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:56.956130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95ecee-4c9c-4505-9fc3-a70fd80d37f0 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.085161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:57.090169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95ecee-4c9c-4505-9fc3-a70fd80d37f0 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.116667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4fbb4-4d67-4fe3-9a3a-c613559f8f43 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.116966 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4fbb4-4d67-4fe3-9a3a-c613559f8f43 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.117225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4fbb4-4d67-4fe3-9a3a-c613559f8f43 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.122623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 200/397] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:57.124002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cba8c-8711-434e-8400-2fdf889505a0 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.124289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cba8c-8711-434e-8400-2fdf889505a0 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.124752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08cba8c-8711-434e-8400-2fdf889505a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.125833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c181eb8-6ae1-44da-ad35-9043674938c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.126629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c181eb8-6ae1-44da-ad35-9043674938c5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.126907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c181eb8-6ae1-44da-ad35-9043674938c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.127212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c181eb8-6ae1-44da-ad35-9043674938c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.142817 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c181eb8-6ae1-44da-ad35-9043674938c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:57.143342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e08cba8c-8711-434e-8400-2fdf889505a0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:57.144675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e08cba8c-8711-434e-8400-2fdf889505a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-6c181eb8-6ae1-44da-ad35-9043674938c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:57.155959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:57.156926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:57.157803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 198/398] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:57.166697 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c181eb8-6ae1-44da-ad35-9043674938c5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.255819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 201/399] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:57.257345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8b21-bf3c-4bc7-a2fd-b15d10508bfb None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.257640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8b21-bf3c-4bc7-a2fd-b15d10508bfb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.257922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b8b21-bf3c-4bc7-a2fd-b15d10508bfb None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.259219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 202/400] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:57.264751 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c2e4a-387a-4dc5-83c2-61103ee291fb None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.265005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c2e4a-387a-4dc5-83c2-61103ee291fb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.265309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c2e4a-387a-4dc5-83c2-61103ee291fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.282571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-cc2c2e4a-387a-4dc5-83c2-61103ee291fb None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:57.283912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-cc2c2e4a-387a-4dc5-83c2-61103ee291fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:57.319795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c181eb8-6ae1-44da-ad35-9043674938c5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.351856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:57.359495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 203/401] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:57.360919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c2e4a-387a-4dc5-83c2-61103ee291fb None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.361340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02c214-6c78-466f-ac92-3e1c3a8685a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.362079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c214-6c78-466f-ac92-3e1c3a8685a8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.367285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c214-6c78-466f-ac92-3e1c3a8685a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.368347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c02c214-6c78-466f-ac92-3e1c3a8685a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.369267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02c214-6c78-466f-ac92-3e1c3a8685a8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:57.369956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02c214-6c78-466f-ac92-3e1c3a8685a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:57.371529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c02c214-6c78-466f-ac92-3e1c3a8685a8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:57.390231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 199/402] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:57.391603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02c214-6c78-466f-ac92-3e1c3a8685a8 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.422548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:57.496500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2c2e4a-387a-4dc5-83c2-61103ee291fb None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.517828 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c02c214-6c78-466f-ac92-3e1c3a8685a8 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.540089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1bffc-33e7-400c-bcda-194cc95e4ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.541515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1bffc-33e7-400c-bcda-194cc95e4ad4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.541943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1bffc-33e7-400c-bcda-194cc95e4ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.542360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd1bffc-33e7-400c-bcda-194cc95e4ad4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.557315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd1bffc-33e7-400c-bcda-194cc95e4ad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:57.563156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b69373-f03f-4fa9-8fe0-7d6370dd2491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.563953 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b69373-f03f-4fa9-8fe0-7d6370dd2491 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.564236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b69373-f03f-4fa9-8fe0-7d6370dd2491 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.564513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b69373-f03f-4fa9-8fe0-7d6370dd2491 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-fcd1bffc-33e7-400c-bcda-194cc95e4ad4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:57.567480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:57.568561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:57.569592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:04:57.571860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 204/403] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:57.572184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1bffc-33e7-400c-bcda-194cc95e4ad4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.579317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b69373-f03f-4fa9-8fe0-7d6370dd2491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-80b69373-f03f-4fa9-8fe0-7d6370dd2491 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:57.589058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:57.590342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 200/404] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:57.592022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b69373-f03f-4fa9-8fe0-7d6370dd2491 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.646075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:57.695274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd1bffc-33e7-400c-bcda-194cc95e4ad4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.710045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:57.734818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b69373-f03f-4fa9-8fe0-7d6370dd2491 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.735140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692849dc-023f-4305-b6ed-b5c4b732c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.735811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692849dc-023f-4305-b6ed-b5c4b732c6bb None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.736096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692849dc-023f-4305-b6ed-b5c4b732c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.736373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692849dc-023f-4305-b6ed-b5c4b732c6bb None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.737668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692849dc-023f-4305-b6ed-b5c4b732c6bb None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:57.739807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692849dc-023f-4305-b6ed-b5c4b732c6bb None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:57.741804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 205/405] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:57.742652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692849dc-023f-4305-b6ed-b5c4b732c6bb None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.781447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2b824-6e99-48b6-8578-ece015a0e8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.782460 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b824-6e99-48b6-8578-ece015a0e8ef None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.782939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b824-6e99-48b6-8578-ece015a0e8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.783446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca2b824-6e99-48b6-8578-ece015a0e8ef None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.784404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2b824-6e99-48b6-8578-ece015a0e8ef None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:57.785626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2b824-6e99-48b6-8578-ece015a0e8ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:57.787799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca2b824-6e99-48b6-8578-ece015a0e8ef None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:57.799353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 201/406] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:57.801139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2b824-6e99-48b6-8578-ece015a0e8ef None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.863915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692849dc-023f-4305-b6ed-b5c4b732c6bb None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.893432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:57.907960 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0748-69aa-4751-832c-7b866353c86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.908457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca2b824-6e99-48b6-8578-ece015a0e8ef None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:57.909154 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0748-69aa-4751-832c-7b866353c86a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.909638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0748-69aa-4751-832c-7b866353c86a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.910763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0748-69aa-4751-832c-7b866353c86a None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.912514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d0748-69aa-4751-832c-7b866353c86a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:57.913026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d0748-69aa-4751-832c-7b866353c86a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:57.914611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d0748-69aa-4751-832c-7b866353c86a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:57.925503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 206/407] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:57.927098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0748-69aa-4751-832c-7b866353c86a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.951578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81b90e-a69c-4c2a-88c0-2c43a7288c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:57.952522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81b90e-a69c-4c2a-88c0-2c43a7288c98 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:57.953064 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81b90e-a69c-4c2a-88c0-2c43a7288c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:57.953236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81b90e-a69c-4c2a-88c0-2c43a7288c98 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:57.954481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81b90e-a69c-4c2a-88c0-2c43a7288c98 None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:57.956200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e81b90e-a69c-4c2a-88c0-2c43a7288c98 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:57.958877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 202/408] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:57.959938 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81b90e-a69c-4c2a-88c0-2c43a7288c98 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:57.977628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.052594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0748-69aa-4751-832c-7b866353c86a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.084772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81b90e-a69c-4c2a-88c0-2c43a7288c98 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.089712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628c58d-0155-4fc5-a26b-1310ac74a622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.090654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628c58d-0155-4fc5-a26b-1310ac74a622 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.091037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628c58d-0155-4fc5-a26b-1310ac74a622 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.091389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b628c58d-0155-4fc5-a26b-1310ac74a622 None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.092714 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628c58d-0155-4fc5-a26b-1310ac74a622 None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.094604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b628c58d-0155-4fc5-a26b-1310ac74a622 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.096812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 207/409] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:58.098365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628c58d-0155-4fc5-a26b-1310ac74a622 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.126866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568910-0db4-4fd7-bed1-37480d33ee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.128594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568910-0db4-4fd7-bed1-37480d33ee66 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.129109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568910-0db4-4fd7-bed1-37480d33ee66 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.129557 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1568910-0db4-4fd7-bed1-37480d33ee66 None admin] PATH_INFO: `/v3/groups/ad3465abebd444dea05fdd65dce9ebe3` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.131409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1568910-0db4-4fd7-bed1-37480d33ee66 None admin] RBAC: Authorizing `identity:get_group(group_id=ad3465abebd444dea05fdd65dce9ebe3)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.133465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1568910-0db4-4fd7-bed1-37480d33ee66 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.136170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 203/410] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:57 2022] GET /identity/v3/groups/ad3465abebd444dea05fdd65dce9ebe3 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:58.137121 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568910-0db4-4fd7-bed1-37480d33ee66 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.166715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.235860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.237689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b628c58d-0155-4fc5-a26b-1310ac74a622 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.261564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1568910-0db4-4fd7-bed1-37480d33ee66 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.277374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c51849-f121-4433-8d1d-43221e942bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.278255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c51849-f121-4433-8d1d-43221e942bfd None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.278548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c51849-f121-4433-8d1d-43221e942bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.278827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c51849-f121-4433-8d1d-43221e942bfd None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc/groups/4ca0321da0934822a42256e0e18c6aae/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.281177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c51849-f121-4433-8d1d-43221e942bfd None admin] RBAC: Authorizing `identity:create_grant(project_id=91700d043c204f948188f50578e3abdc, group_id=4ca0321da0934822a42256e0e18c6aae, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.282775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c51849-f121-4433-8d1d-43221e942bfd None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.303095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 208/411] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jul 21 04:04:58 2022] PUT /identity/v3/projects/91700d043c204f948188f50578e3abdc/groups/4ca0321da0934822a42256e0e18c6aae/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:58.304141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c51849-f121-4433-8d1d-43221e942bfd None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.306418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff381e-ab5a-4a69-b2c3-92c89fd69cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.307786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff381e-ab5a-4a69-b2c3-92c89fd69cae None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.308339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff381e-ab5a-4a69-b2c3-92c89fd69cae None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.308845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff381e-ab5a-4a69-b2c3-92c89fd69cae None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.310508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff381e-ab5a-4a69-b2c3-92c89fd69cae None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.312328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ff381e-ab5a-4a69-b2c3-92c89fd69cae None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.314717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 204/412] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:58 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:58.320947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff381e-ab5a-4a69-b2c3-92c89fd69cae None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.509345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c51849-f121-4433-8d1d-43221e942bfd None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.510006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ff381e-ab5a-4a69-b2c3-92c89fd69cae None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.528247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.555335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453f40-efdf-449e-87ba-a29499667d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.556707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453f40-efdf-449e-87ba-a29499667d27 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.557189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453f40-efdf-449e-87ba-a29499667d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.557680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad453f40-efdf-449e-87ba-a29499667d27 None admin] PATH_INFO: `/v3/projects/39bed1c15cc5411994e7f051730f1155` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.559196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453f40-efdf-449e-87ba-a29499667d27 None admin] RBAC: Authorizing `identity:get_project(project_id=39bed1c15cc5411994e7f051730f1155)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.560950 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad453f40-efdf-449e-87ba-a29499667d27 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.561987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d6e298-da12-457e-85ae-cfe550fc4133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.562881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e298-da12-457e-85ae-cfe550fc4133 None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.563219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e298-da12-457e-85ae-cfe550fc4133 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.563500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d6e298-da12-457e-85ae-cfe550fc4133 None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc/groups/4ca0321da0934822a42256e0e18c6aae/roles/b29b8d5f31b44d8b90eb10c34acbc06a` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.563766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 209/413] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:58 2022] GET /identity/v3/projects/39bed1c15cc5411994e7f051730f1155 => generated 344 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:58.570658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453f40-efdf-449e-87ba-a29499667d27 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.573166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6e298-da12-457e-85ae-cfe550fc4133 None admin] RBAC: Authorizing `identity:create_grant(project_id=91700d043c204f948188f50578e3abdc, group_id=4ca0321da0934822a42256e0e18c6aae, role_id=b29b8d5f31b44d8b90eb10c34acbc06a)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.574648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d6e298-da12-457e-85ae-cfe550fc4133 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.600249 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 205/414] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jul 21 04:04:58 2022] PUT /identity/v3/projects/91700d043c204f948188f50578e3abdc/groups/4ca0321da0934822a42256e0e18c6aae/roles/b29b8d5f31b44d8b90eb10c34acbc06a => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:58.602646 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803d1ab-1fc5-44d3-874a-94d1287f83b0 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.602939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803d1ab-1fc5-44d3-874a-94d1287f83b0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.603239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f803d1ab-1fc5-44d3-874a-94d1287f83b0 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.604920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 206/415] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:04:58.610454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef435f-f31f-408f-b5d1-24a17278e62d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.610794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef435f-f31f-408f-b5d1-24a17278e62d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.611055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef435f-f31f-408f-b5d1-24a17278e62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.630375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-caef435f-f31f-408f-b5d1-24a17278e62d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:58.631835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-caef435f-f31f-408f-b5d1-24a17278e62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:58.634174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.711510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 207/416] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:04:58.716037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad453f40-efdf-449e-87ba-a29499667d27 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.735691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef435f-f31f-408f-b5d1-24a17278e62d None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:58.763048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffaf7f-f5d4-4681-b683-53f43c78beed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.764424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffaf7f-f5d4-4681-b683-53f43c78beed None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.765233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffaf7f-f5d4-4681-b683-53f43c78beed None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.766247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffaf7f-f5d4-4681-b683-53f43c78beed None admin] PATH_INFO: `/v3/projects/39bed1c15cc5411994e7f051730f1155/groups/ad3465abebd444dea05fdd65dce9ebe3/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.770790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffaf7f-f5d4-4681-b683-53f43c78beed None admin] RBAC: Authorizing `identity:create_grant(project_id=39bed1c15cc5411994e7f051730f1155, group_id=ad3465abebd444dea05fdd65dce9ebe3, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:58.773409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffaf7f-f5d4-4681-b683-53f43c78beed None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:58.799482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 210/417] 10.222.0.48 () {58 vars in 1442 bytes} [Thu Jul 21 04:04:58 2022] PUT /identity/v3/projects/39bed1c15cc5411994e7f051730f1155/groups/ad3465abebd444dea05fdd65dce9ebe3/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:04:58.878490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef435f-f31f-408f-b5d1-24a17278e62d None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:58.919894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290435b2-0179-46e0-b536-d502d73b3c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:58.920701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290435b2-0179-46e0-b536-d502d73b3c8e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:58.920983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290435b2-0179-46e0-b536-d502d73b3c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:58.921254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290435b2-0179-46e0-b536-d502d73b3c8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:58.929631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:58.934348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290435b2-0179-46e0-b536-d502d73b3c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-290435b2-0179-46e0-b536-d502d73b3c8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:58.943698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:58.944681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:04:58.945498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:58.951311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 208/418] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:04:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:04:58.954472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffaf7f-f5d4-4681-b683-53f43c78beed None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:59.008392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:59.013439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ee348-e106-4051-802a-76348928c871 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.013674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ee348-e106-4051-802a-76348928c871 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.013933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ee348-e106-4051-802a-76348928c871 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.015811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 209/419] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:04:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:04:59.021459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361e2d-f63a-455c-9077-f90d16e6874b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.021745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361e2d-f63a-455c-9077-f90d16e6874b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.022027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39361e2d-f63a-455c-9077-f90d16e6874b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.041731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-39361e2d-f63a-455c-9077-f90d16e6874b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:04:59.043247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-39361e2d-f63a-455c-9077-f90d16e6874b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:04:59.089519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffaf7f-f5d4-4681-b683-53f43c78beed None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:59.130767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 210/420] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:04:59.146585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24c35-c3ac-4395-a464-d6f2f759eff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:59.147288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24c35-c3ac-4395-a464-d6f2f759eff2 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.147571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24c35-c3ac-4395-a464-d6f2f759eff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.147844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24c35-c3ac-4395-a464-d6f2f759eff2 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.148596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb24c35-c3ac-4395-a464-d6f2f759eff2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:59.148908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb24c35-c3ac-4395-a464-d6f2f759eff2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:59.150309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb24c35-c3ac-4395-a464-d6f2f759eff2 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:59.165857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 211/421] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:04:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:59.170931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39361e2d-f63a-455c-9077-f90d16e6874b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:59.171091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24c35-c3ac-4395-a464-d6f2f759eff2 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:59.329196 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39361e2d-f63a-455c-9077-f90d16e6874b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:59.379355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:59.386832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24c35-c3ac-4395-a464-d6f2f759eff2 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:59.390316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:59.395344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d548e6-2d69-45e5-98af-181056c15741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:59.396230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d548e6-2d69-45e5-98af-181056c15741 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.396509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d548e6-2d69-45e5-98af-181056c15741 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.396782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d548e6-2d69-45e5-98af-181056c15741 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.415388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d548e6-2d69-45e5-98af-181056c15741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-95d548e6-2d69-45e5-98af-181056c15741 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:04:59.427809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:04:59.428723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:04:59.429531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:04:59.430808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 211/422] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:04:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:04:59.435623 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d548e6-2d69-45e5-98af-181056c15741 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:59.453882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddd35d-72af-4bfb-9f70-a05347f8f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:59.455174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd35d-72af-4bfb-9f70-a05347f8f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.455667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd35d-72af-4bfb-9f70-a05347f8f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.456147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dddd35d-72af-4bfb-9f70-a05347f8f1d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.583562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddd35d-72af-4bfb-9f70-a05347f8f1d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:59.584963 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dddd35d-72af-4bfb-9f70-a05347f8f1d9 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:59.633671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d548e6-2d69-45e5-98af-181056c15741 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:59.684892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e59115-917b-457a-a741-0c5faec2b46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:59.685570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e59115-917b-457a-a741-0c5faec2b46e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.685853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e59115-917b-457a-a741-0c5faec2b46e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.686129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e59115-917b-457a-a741-0c5faec2b46e None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.686881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e59115-917b-457a-a741-0c5faec2b46e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:04:59.687230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e59115-917b-457a-a741-0c5faec2b46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:59.688628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e59115-917b-457a-a741-0c5faec2b46e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:59.706008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 212/423] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:04:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:04:59.712333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e59115-917b-457a-a741-0c5faec2b46e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:59.748152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 212/424] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:04:59.753715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddd35d-72af-4bfb-9f70-a05347f8f1d9 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:04:59.760764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:59.787354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:04:59.877295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e59115-917b-457a-a741-0c5faec2b46e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:59.919272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dddd35d-72af-4bfb-9f70-a05347f8f1d9 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:04:59.945087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2eef4-e480-4d1c-9f58-77f049f1ceae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:59.945738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2eef4-e480-4d1c-9f58-77f049f1ceae None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.946022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2eef4-e480-4d1c-9f58-77f049f1ceae None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.946297 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2eef4-e480-4d1c-9f58-77f049f1ceae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.986732 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db30b-4e2b-486e-8d48-f91c2c571baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:04:59.987625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db30b-4e2b-486e-8d48-f91c2c571baa None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:04:59.987903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db30b-4e2b-486e-8d48-f91c2c571baa None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:04:59.988751 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99db30b-4e2b-486e-8d48-f91c2c571baa None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:04:59.989960 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db30b-4e2b-486e-8d48-f91c2c571baa None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:04:59.991448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99db30b-4e2b-486e-8d48-f91c2c571baa None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:04:59.993447 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 213/425] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:04:59 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:04:59.998679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db30b-4e2b-486e-8d48-f91c2c571baa None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.078225 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2eef4-e480-4d1c-9f58-77f049f1ceae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.079719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2eef4-e480-4d1c-9f58-77f049f1ceae None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.138909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.177407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.198123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99db30b-4e2b-486e-8d48-f91c2c571baa None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.263281 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c04f5-e808-4042-a8f8-cfaed5f9c005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.264529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c04f5-e808-4042-a8f8-cfaed5f9c005 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.265046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c04f5-e808-4042-a8f8-cfaed5f9c005 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.265525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c04f5-e808-4042-a8f8-cfaed5f9c005 None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.266911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c04f5-e808-4042-a8f8-cfaed5f9c005 None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.268620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c04f5-e808-4042-a8f8-cfaed5f9c005 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.270987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 214/426] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:04:59 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:00.275219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 213/427] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:05:00.277755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c04f5-e808-4042-a8f8-cfaed5f9c005 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.281939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2eef4-e480-4d1c-9f58-77f049f1ceae None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.460688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2eef4-e480-4d1c-9f58-77f049f1ceae None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.463279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c04f5-e808-4042-a8f8-cfaed5f9c005 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.523871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c965f7-f085-456a-9fc4-92721cfa1f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.524883 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c965f7-f085-456a-9fc4-92721cfa1f09 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.525371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c965f7-f085-456a-9fc4-92721cfa1f09 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.525851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c965f7-f085-456a-9fc4-92721cfa1f09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.526888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c965f7-f085-456a-9fc4-92721cfa1f09 None admin] RBAC: Adding query filter params (group.id=4ca0321da0934822a42256e0e18c6aae, role.id=49806c1799404d039cb4e2a11f1d4442, scope.project.id=6a4c69c73a874668837daa9a9951b335) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:00.527544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c965f7-f085-456a-9fc4-92721cfa1f09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.528191 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34403fd-8365-4642-9c10-3367911195f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.529069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34403fd-8365-4642-9c10-3367911195f3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.529355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34403fd-8365-4642-9c10-3367911195f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.529632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34403fd-8365-4642-9c10-3367911195f3 None admin] PATH_INFO: `/v3/projects/6a4c69c73a874668837daa9a9951b335` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.530161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c965f7-f085-456a-9fc4-92721cfa1f09 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.530832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34403fd-8365-4642-9c10-3367911195f3 None admin] RBAC: Authorizing `identity:get_project(project_id=6a4c69c73a874668837daa9a9951b335)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.532471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34403fd-8365-4642-9c10-3367911195f3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.535290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 214/428] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/projects/6a4c69c73a874668837daa9a9951b335 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:00.537364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 215/429] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/role_assignments?group.id=4ca0321da0934822a42256e0e18c6aae&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 611 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:00.543162 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34403fd-8365-4642-9c10-3367911195f3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.588945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.692776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34403fd-8365-4642-9c10-3367911195f3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.743760 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc740de-49c9-4ebc-85b9-50782a98632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.744607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc740de-49c9-4ebc-85b9-50782a98632d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.744897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc740de-49c9-4ebc-85b9-50782a98632d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.745172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc740de-49c9-4ebc-85b9-50782a98632d None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.746376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc740de-49c9-4ebc-85b9-50782a98632d None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.747926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc740de-49c9-4ebc-85b9-50782a98632d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.749601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 215/430] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:00.749977 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8134970-3a8e-456c-9b54-a3ae59535686 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.750902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8134970-3a8e-456c-9b54-a3ae59535686 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.751428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8134970-3a8e-456c-9b54-a3ae59535686 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.753043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 216/431] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:00.756452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc740de-49c9-4ebc-85b9-50782a98632d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.760649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746f71e-7a84-4d59-971d-2aac8a7d88ea None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.760937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746f71e-7a84-4d59-971d-2aac8a7d88ea None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.761212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746f71e-7a84-4d59-971d-2aac8a7d88ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.773748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.802990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d746f71e-7a84-4d59-971d-2aac8a7d88ea None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:00.802990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d746f71e-7a84-4d59-971d-2aac8a7d88ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:00.860267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:00.876943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc740de-49c9-4ebc-85b9-50782a98632d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:00.899425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 217/432] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:00.935676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746f71e-7a84-4d59-971d-2aac8a7d88ea None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:00.940667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be123f9-0c9b-4ea4-b97f-b40c0630281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:00.941372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be123f9-0c9b-4ea4-b97f-b40c0630281f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:00.941657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be123f9-0c9b-4ea4-b97f-b40c0630281f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:00.941932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be123f9-0c9b-4ea4-b97f-b40c0630281f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:00.942774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be123f9-0c9b-4ea4-b97f-b40c0630281f None admin] RBAC: Adding query filter params (group.id=4ca0321da0934822a42256e0e18c6aae, role.id=b29b8d5f31b44d8b90eb10c34acbc06a, scope.project.id=6a4c69c73a874668837daa9a9951b335) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:00.943111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be123f9-0c9b-4ea4-b97f-b40c0630281f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:00.945008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be123f9-0c9b-4ea4-b97f-b40c0630281f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:00.953086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 216/433] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/role_assignments?group.id=4ca0321da0934822a42256e0e18c6aae&scope.project.id=6a4c69c73a874668837daa9a9951b335&role.id=b29b8d5f31b44d8b90eb10c34acbc06a => generated 611 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:01.059474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746f71e-7a84-4d59-971d-2aac8a7d88ea None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.097134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02142678-4077-4595-b400-523a0d28286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.098472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142678-4077-4595-b400-523a0d28286e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.098755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142678-4077-4595-b400-523a0d28286e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.099057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02142678-4077-4595-b400-523a0d28286e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.101328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.111734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02142678-4077-4595-b400-523a0d28286e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-02142678-4077-4595-b400-523a0d28286e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:01.120685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:01.121720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:01.122514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 218/434] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:01.127930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be123f9-0c9b-4ea4-b97f-b40c0630281f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.154006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7d622-8e3c-4e17-808f-bb015dc55659 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.154298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7d622-8e3c-4e17-808f-bb015dc55659 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.154568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7d622-8e3c-4e17-808f-bb015dc55659 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.156199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 219/435] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:01.162051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035798-b587-4c9f-b155-9a13198ca4da None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.162622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035798-b587-4c9f-b155-9a13198ca4da None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.163220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe035798-b587-4c9f-b155-9a13198ca4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.186312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fe035798-b587-4c9f-b155-9a13198ca4da None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:01.187551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fe035798-b587-4c9f-b155-9a13198ca4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:01.263263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be123f9-0c9b-4ea4-b97f-b40c0630281f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.282374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 220/436] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:01.306980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035798-b587-4c9f-b155-9a13198ca4da None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.311253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316586d-05a0-41cc-9925-bfa8364552c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.311983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316586d-05a0-41cc-9925-bfa8364552c4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.312380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316586d-05a0-41cc-9925-bfa8364552c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.312755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316586d-05a0-41cc-9925-bfa8364552c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.313606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316586d-05a0-41cc-9925-bfa8364552c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:01.314010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316586d-05a0-41cc-9925-bfa8364552c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:01.315529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5316586d-05a0-41cc-9925-bfa8364552c4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:01.325990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 217/437] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:01.332521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316586d-05a0-41cc-9925-bfa8364552c4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.350515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.436856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe035798-b587-4c9f-b155-9a13198ca4da None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.458605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5316586d-05a0-41cc-9925-bfa8364552c4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.462644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.479803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbb05c-7e30-42ce-a395-945796b6a628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.480623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb05c-7e30-42ce-a395-945796b6a628 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.481329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb05c-7e30-42ce-a395-945796b6a628 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.481617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbb05c-7e30-42ce-a395-945796b6a628 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.495237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbb05c-7e30-42ce-a395-945796b6a628 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:01.496588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4a78c-2f37-422e-aa3b-3d0618b0db2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.497358 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4a78c-2f37-422e-aa3b-3d0618b0db2c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.497645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4a78c-2f37-422e-aa3b-3d0618b0db2c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.497922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4a78c-2f37-422e-aa3b-3d0618b0db2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-08bbb05c-7e30-42ce-a395-945796b6a628 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:01.505024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:01.506138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:01.507235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 221/438] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:01.508042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff26fe-dfaa-44fd-9cca-652b1e6735ef None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.508129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff26fe-dfaa-44fd-9cca-652b1e6735ef None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.509249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff26fe-dfaa-44fd-9cca-652b1e6735ef None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.511107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 222/439] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:01.515076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff26fe-dfaa-44fd-9cca-652b1e6735ef None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.574040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4a78c-2f37-422e-aa3b-3d0618b0db2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:01.575461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4a78c-2f37-422e-aa3b-3d0618b0db2c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:01.590014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.625416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff26fe-dfaa-44fd-9cca-652b1e6735ef None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.658603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c40a8d-1dcf-471b-9eea-86eb6b67b53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.659295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40a8d-1dcf-471b-9eea-86eb6b67b53e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.659573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40a8d-1dcf-471b-9eea-86eb6b67b53e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.659842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40a8d-1dcf-471b-9eea-86eb6b67b53e None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.660611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c40a8d-1dcf-471b-9eea-86eb6b67b53e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:01.660916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c40a8d-1dcf-471b-9eea-86eb6b67b53e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:01.662291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c40a8d-1dcf-471b-9eea-86eb6b67b53e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:01.670191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 223/440] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:01.671426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc9e7-6801-40e2-b641-ca4324aff584 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.671717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc9e7-6801-40e2-b641-ca4324aff584 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.671994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cc9e7-6801-40e2-b641-ca4324aff584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.681320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 218/441] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:05:01.681320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4a78c-2f37-422e-aa3b-3d0618b0db2c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.692921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ed4cc9e7-6801-40e2-b641-ca4324aff584 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:01.694111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ed4cc9e7-6801-40e2-b641-ca4324aff584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:01.735684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.760834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 224/442] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:01.762261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cc9e7-6801-40e2-b641-ca4324aff584 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.780030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4a78c-2f37-422e-aa3b-3d0618b0db2c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.793188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.813527 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9963b9-c9d8-4155-bce0-313b65a0dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.814164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9963b9-c9d8-4155-bce0-313b65a0dec1 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.814448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9963b9-c9d8-4155-bce0-313b65a0dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.814720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9963b9-c9d8-4155-bce0-313b65a0dec1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.861662 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cc9e7-6801-40e2-b641-ca4324aff584 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:01.882615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9963b9-c9d8-4155-bce0-313b65a0dec1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:01.884118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9963b9-c9d8-4155-bce0-313b65a0dec1 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:01.895112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3322779-eb13-4d35-b4d0-64442500cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:01.895975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3322779-eb13-4d35-b4d0-64442500cb8a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:01.896259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3322779-eb13-4d35-b4d0-64442500cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:01.896530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3322779-eb13-4d35-b4d0-64442500cb8a None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:01.897695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3322779-eb13-4d35-b4d0-64442500cb8a None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:01.899165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3322779-eb13-4d35-b4d0-64442500cb8a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:01.905543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 225/443] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:01.905543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3322779-eb13-4d35-b4d0-64442500cb8a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.948910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:01.981150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 219/444] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:01.982027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9963b9-c9d8-4155-bce0-313b65a0dec1 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:01.996575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:02.011996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3322779-eb13-4d35-b4d0-64442500cb8a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.045086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f3bf3-56cb-4ff9-835c-7131ecbdd782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.045868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f3bf3-56cb-4ff9-835c-7131ecbdd782 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.046147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f3bf3-56cb-4ff9-835c-7131ecbdd782 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.046421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f3bf3-56cb-4ff9-835c-7131ecbdd782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.056840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f3bf3-56cb-4ff9-835c-7131ecbdd782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-cd5f3bf3-56cb-4ff9-835c-7131ecbdd782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:02.064508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:02.065395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:02.066194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 226/445] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:02.067680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f3bf3-56cb-4ff9-835c-7131ecbdd782 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:02.080627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9963b9-c9d8-4155-bce0-313b65a0dec1 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.115773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07374bd9-6849-4a22-ba90-26b32fa31dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.116551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07374bd9-6849-4a22-ba90-26b32fa31dea None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.116837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07374bd9-6849-4a22-ba90-26b32fa31dea None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.117116 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07374bd9-6849-4a22-ba90-26b32fa31dea None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.118329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07374bd9-6849-4a22-ba90-26b32fa31dea None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:02.119821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07374bd9-6849-4a22-ba90-26b32fa31dea None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:02.121439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 220/446] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:01 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:02.122198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07374bd9-6849-4a22-ba90-26b32fa31dea None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:02.169994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f3bf3-56cb-4ff9-835c-7131ecbdd782 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.172222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:02.203885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:02.207939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ba07f-cb39-4b54-af2a-62eae747462e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.208801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba07f-cb39-4b54-af2a-62eae747462e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.209087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba07f-cb39-4b54-af2a-62eae747462e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.209364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ba07f-cb39-4b54-af2a-62eae747462e None admin] PATH_INFO: `/v3/projects/91700d043c204f948188f50578e3abdc` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.210565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ba07f-cb39-4b54-af2a-62eae747462e None admin] RBAC: Authorizing `identity:get_project(project_id=91700d043c204f948188f50578e3abdc)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:02.212067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ba07f-cb39-4b54-af2a-62eae747462e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:02.214017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 227/447] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:02 2022] GET /identity/v3/projects/91700d043c204f948188f50578e3abdc => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:02.214784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ba07f-cb39-4b54-af2a-62eae747462e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:02.226983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07374bd9-6849-4a22-ba90-26b32fa31dea None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.261072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0edb2-ec7b-4421-9111-d2edac26bc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.261736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0edb2-ec7b-4421-9111-d2edac26bc0f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.262019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0edb2-ec7b-4421-9111-d2edac26bc0f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.262296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0edb2-ec7b-4421-9111-d2edac26bc0f None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.263072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0edb2-ec7b-4421-9111-d2edac26bc0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:02.263376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0edb2-ec7b-4421-9111-d2edac26bc0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:02.264763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0edb2-ec7b-4421-9111-d2edac26bc0f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:02.273209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 221/448] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:02.274116 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0edb2-ec7b-4421-9111-d2edac26bc0f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:02.317488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ba07f-cb39-4b54-af2a-62eae747462e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.350163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069634cb-47a3-4ad0-8a2c-05315336c37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.350812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069634cb-47a3-4ad0-8a2c-05315336c37f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.351132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069634cb-47a3-4ad0-8a2c-05315336c37f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.351404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069634cb-47a3-4ad0-8a2c-05315336c37f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.352218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069634cb-47a3-4ad0-8a2c-05315336c37f None admin] RBAC: Adding query filter params (group.id=4ca0321da0934822a42256e0e18c6aae, role.id=49806c1799404d039cb4e2a11f1d4442, scope.project.id=91700d043c204f948188f50578e3abdc) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:02.352523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069634cb-47a3-4ad0-8a2c-05315336c37f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:02.353958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069634cb-47a3-4ad0-8a2c-05315336c37f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:02.359623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 228/449] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:02 2022] GET /identity/v3/role_assignments?group.id=4ca0321da0934822a42256e0e18c6aae&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=49806c1799404d039cb4e2a11f1d4442 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:02.360382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069634cb-47a3-4ad0-8a2c-05315336c37f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:02.373851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0edb2-ec7b-4421-9111-d2edac26bc0f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.401568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:02.412347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac0230-ec95-43bd-94b7-991902dce7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.413233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac0230-ec95-43bd-94b7-991902dce7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.413514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac0230-ec95-43bd-94b7-991902dce7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.413784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ac0230-ec95-43bd-94b7-991902dce7b5 None admin] PATH_INFO: `/v3/groups/4ca0321da0934822a42256e0e18c6aae` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.415111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac0230-ec95-43bd-94b7-991902dce7b5 None admin] RBAC: Authorizing `identity:get_group(group_id=4ca0321da0934822a42256e0e18c6aae)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:02.416635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ac0230-ec95-43bd-94b7-991902dce7b5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:02.418815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 222/450] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:02 2022] GET /identity/v3/groups/4ca0321da0934822a42256e0e18c6aae => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:02.424333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac0230-ec95-43bd-94b7-991902dce7b5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:02.439049 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:02.483392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069634cb-47a3-4ad0-8a2c-05315336c37f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.529067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80a253-361f-4b82-a615-ea142449737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.529719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80a253-361f-4b82-a615-ea142449737c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.530002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80a253-361f-4b82-a615-ea142449737c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.530277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd80a253-361f-4b82-a615-ea142449737c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.540312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ac0230-ec95-43bd-94b7-991902dce7b5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.583149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f2ea8-2bd3-4aa2-a759-bf2b731b5574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.583792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f2ea8-2bd3-4aa2-a759-bf2b731b5574 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.584076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f2ea8-2bd3-4aa2-a759-bf2b731b5574 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.584350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f2ea8-2bd3-4aa2-a759-bf2b731b5574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.585179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f2ea8-2bd3-4aa2-a759-bf2b731b5574 None admin] RBAC: Adding query filter params (group.id=4ca0321da0934822a42256e0e18c6aae, role.id=b29b8d5f31b44d8b90eb10c34acbc06a, scope.project.id=91700d043c204f948188f50578e3abdc) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:02.585489 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f2ea8-2bd3-4aa2-a759-bf2b731b5574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:02.586941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f2ea8-2bd3-4aa2-a759-bf2b731b5574 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:02.595193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 223/451] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:02 2022] GET /identity/v3/role_assignments?group.id=4ca0321da0934822a42256e0e18c6aae&scope.project.id=91700d043c204f948188f50578e3abdc&role.id=b29b8d5f31b44d8b90eb10c34acbc06a => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:02.614192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80a253-361f-4b82-a615-ea142449737c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:02.615787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd80a253-361f-4b82-a615-ea142449737c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:02.654455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:02.734741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 229/452] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:02.741373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f2ea8-2bd3-4aa2-a759-bf2b731b5574 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:02.819215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:02.845288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f2ea8-2bd3-4aa2-a759-bf2b731b5574 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:02.879784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2f9d0-ad5d-47fa-a0f2-e3087dac54d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:02.880635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2f9d0-ad5d-47fa-a0f2-e3087dac54d3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:02.880918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2f9d0-ad5d-47fa-a0f2-e3087dac54d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:02.881187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2f9d0-ad5d-47fa-a0f2-e3087dac54d3 None admin] PATH_INFO: `/v3/projects/39bed1c15cc5411994e7f051730f1155` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:02.882371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2f9d0-ad5d-47fa-a0f2-e3087dac54d3 None admin] RBAC: Authorizing `identity:get_project(project_id=39bed1c15cc5411994e7f051730f1155)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:02.883857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e2f9d0-ad5d-47fa-a0f2-e3087dac54d3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:02.885552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 224/453] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:05:02 2022] GET /identity/v3/projects/39bed1c15cc5411994e7f051730f1155 => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:02.891137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80a253-361f-4b82-a615-ea142449737c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:02.989468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd80a253-361f-4b82-a615-ea142449737c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:03.021753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b19394-af83-48c3-b529-edfad5d01f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:03.022598 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b19394-af83-48c3-b529-edfad5d01f47 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.022877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b19394-af83-48c3-b529-edfad5d01f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.023200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b19394-af83-48c3-b529-edfad5d01f47 None admin] PATH_INFO: `/v3/groups/ad3465abebd444dea05fdd65dce9ebe3` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.024337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b19394-af83-48c3-b529-edfad5d01f47 None admin] RBAC: Authorizing `identity:get_group(group_id=ad3465abebd444dea05fdd65dce9ebe3)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:03.025770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b19394-af83-48c3-b529-edfad5d01f47 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:03.027399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 230/454] 10.222.0.48 () {56 vars in 1180 bytes} [Thu Jul 21 04:05:02 2022] GET /identity/v3/groups/ad3465abebd444dea05fdd65dce9ebe3 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:03.033268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2f9d0-ad5d-47fa-a0f2-e3087dac54d3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:03.130376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2f9d0-ad5d-47fa-a0f2-e3087dac54d3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:03.162110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f92685-2ba8-431b-bad8-f234a20e1983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:03.162740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f92685-2ba8-431b-bad8-f234a20e1983 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:03.163046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f92685-2ba8-431b-bad8-f234a20e1983 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:03.163318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f92685-2ba8-431b-bad8-f234a20e1983 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:03.164133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f92685-2ba8-431b-bad8-f234a20e1983 None admin] RBAC: Adding query filter params (group.id=ad3465abebd444dea05fdd65dce9ebe3, role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=39bed1c15cc5411994e7f051730f1155) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:03.164441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f92685-2ba8-431b-bad8-f234a20e1983 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:03.165860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f92685-2ba8-431b-bad8-f234a20e1983 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:03.171471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 225/455] 10.222.0.48 () {56 vars in 1376 bytes} [Thu Jul 21 04:05:03 2022] GET /identity/v3/role_assignments?group.id=ad3465abebd444dea05fdd65dce9ebe3&scope.project.id=39bed1c15cc5411994e7f051730f1155&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:05.608389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba619c-a196-4a42-86b8-9a41c152e378 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:05.608866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba619c-a196-4a42-86b8-9a41c152e378 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:05.608866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ba619c-a196-4a42-86b8-9a41c152e378 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:05.610648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 231/456] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:05.616410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955670e7-5909-4fb8-b61b-e8ad02d51afb None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:05.617265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955670e7-5909-4fb8-b61b-e8ad02d51afb None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:05.617748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955670e7-5909-4fb8-b61b-e8ad02d51afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:05.631605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:05.644032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-955670e7-5909-4fb8-b61b-e8ad02d51afb None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:05.646138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-955670e7-5909-4fb8-b61b-e8ad02d51afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:05.739559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 226/457] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:05.788793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba619c-a196-4a42-86b8-9a41c152e378 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:05.793801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:05.882091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7c97d-bec8-4857-8c9a-9f28e6d5e563 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:05.882702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7c97d-bec8-4857-8c9a-9f28e6d5e563 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:05.883378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f7c97d-bec8-4857-8c9a-9f28e6d5e563 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:05.885243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 227/458] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:05.890077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2e595-f95b-4afe-8eb1-7cbbf1bd078d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:05.890614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2e595-f95b-4afe-8eb1-7cbbf1bd078d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:05.891141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2e595-f95b-4afe-8eb1-7cbbf1bd078d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:05.924898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-dbc2e595-f95b-4afe-8eb1-7cbbf1bd078d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:05.926615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-dbc2e595-f95b-4afe-8eb1-7cbbf1bd078d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:05.950985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ba619c-a196-4a42-86b8-9a41c152e378 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.023250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84847836-e6d4-4bea-b52f-f4383df8a4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.024050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84847836-e6d4-4bea-b52f-f4383df8a4ba None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.024330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84847836-e6d4-4bea-b52f-f4383df8a4ba None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.024603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84847836-e6d4-4bea-b52f-f4383df8a4ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.036417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 228/459] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:06.040916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84847836-e6d4-4bea-b52f-f4383df8a4ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.042402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84847836-e6d4-4bea-b52f-f4383df8a4ba None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.060955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2e595-f95b-4afe-8eb1-7cbbf1bd078d None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-84847836-e6d4-4bea-b52f-f4383df8a4ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:06.071701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:06.072597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:06.073457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:06.073457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:06.073457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:06.073457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:06.083205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 232/460] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:06.089075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84847836-e6d4-4bea-b52f-f4383df8a4ba None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.136220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.164363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.175419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2e595-f95b-4afe-8eb1-7cbbf1bd078d None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.218804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84847836-e6d4-4bea-b52f-f4383df8a4ba None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.219999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01c266b-2f70-4e04-911f-60e74131f1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.221156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c266b-2f70-4e04-911f-60e74131f1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.221640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c266b-2f70-4e04-911f-60e74131f1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.222107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01c266b-2f70-4e04-911f-60e74131f1e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.233723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c266b-2f70-4e04-911f-60e74131f1e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.235626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01c266b-2f70-4e04-911f-60e74131f1e8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.258023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d903719-0e03-4dbd-a361-7c2097550029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.258737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d903719-0e03-4dbd-a361-7c2097550029 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.259042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d903719-0e03-4dbd-a361-7c2097550029 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.259316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d903719-0e03-4dbd-a361-7c2097550029 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.260087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d903719-0e03-4dbd-a361-7c2097550029 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:06.260391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d903719-0e03-4dbd-a361-7c2097550029 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-a01c266b-2f70-4e04-911f-60e74131f1e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:06.261003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:06.261984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:06.263071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:06.263071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:06.263071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:06.263071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:06.263296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d903719-0e03-4dbd-a361-7c2097550029 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.265743 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 229/461] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:06.267165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b688e-d7ee-4ff9-9ff5-61e9e090939c None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.267595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b688e-d7ee-4ff9-9ff5-61e9e090939c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.268014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b688e-d7ee-4ff9-9ff5-61e9e090939c None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.274165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 230/462] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:06.274165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b688e-d7ee-4ff9-9ff5-61e9e090939c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.281214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 233/463] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:06.282767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655143d7-08f4-4d3e-a7b1-cd53a1f012ff None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.288025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655143d7-08f4-4d3e-a7b1-cd53a1f012ff None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.288649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655143d7-08f4-4d3e-a7b1-cd53a1f012ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.306742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-655143d7-08f4-4d3e-a7b1-cd53a1f012ff None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:06.308290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-655143d7-08f4-4d3e-a7b1-cd53a1f012ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:06.379716 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b688e-d7ee-4ff9-9ff5-61e9e090939c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.391036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 234/464] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:06.391036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655143d7-08f4-4d3e-a7b1-cd53a1f012ff None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.397864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.416961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd282e10-88f0-4578-a205-85fe8f95cf90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.417618 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd282e10-88f0-4578-a205-85fe8f95cf90 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.417898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd282e10-88f0-4578-a205-85fe8f95cf90 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.418297 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd282e10-88f0-4578-a205-85fe8f95cf90 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.419047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd282e10-88f0-4578-a205-85fe8f95cf90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:06.419777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd282e10-88f0-4578-a205-85fe8f95cf90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.421177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd282e10-88f0-4578-a205-85fe8f95cf90 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.433268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 231/465] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:06.434520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690816-6ada-4713-8781-9bb5a69315bc None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.434808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690816-6ada-4713-8781-9bb5a69315bc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.435126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09690816-6ada-4713-8781-9bb5a69315bc None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.436479 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 232/466] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:06.437044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690816-6ada-4713-8781-9bb5a69315bc None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.453191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.509791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655143d7-08f4-4d3e-a7b1-cd53a1f012ff None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.547345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4c38-718c-4ab1-a404-e978bf9aff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.548009 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4c38-718c-4ab1-a404-e978bf9aff99 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.548289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4c38-718c-4ab1-a404-e978bf9aff99 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.548561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02e4c38-718c-4ab1-a404-e978bf9aff99 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.549258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e4c38-718c-4ab1-a404-e978bf9aff99 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.551332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02e4c38-718c-4ab1-a404-e978bf9aff99 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.553914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09690816-6ada-4713-8781-9bb5a69315bc None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.580833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 235/467] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:06 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:06.581946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4c38-718c-4ab1-a404-e978bf9aff99 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.592149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306f4005-61e3-4357-b114-4c6df6287ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.592990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4005-61e3-4357-b114-4c6df6287ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.593270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4005-61e3-4357-b114-4c6df6287ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.593544 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306f4005-61e3-4357-b114-4c6df6287ee1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.610040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f4005-61e3-4357-b114-4c6df6287ee1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.612018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306f4005-61e3-4357-b114-4c6df6287ee1 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-306f4005-61e3-4357-b114-4c6df6287ee1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:06.634814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:06.636175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:06.637004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:06.637004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:06.637004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:06.637004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:06.639395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 233/468] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:06.640892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc50703-fb77-4477-9eb6-5094bf371267 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.641431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc50703-fb77-4477-9eb6-5094bf371267 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.641951 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc50703-fb77-4477-9eb6-5094bf371267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.661131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-cfc50703-fb77-4477-9eb6-5094bf371267 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:06.662810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-cfc50703-fb77-4477-9eb6-5094bf371267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:06.690940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.717072 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02e4c38-718c-4ab1-a404-e978bf9aff99 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.719050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:06.745894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 234/469] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:06.747189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc50703-fb77-4477-9eb6-5094bf371267 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.760967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7941024-98d8-4a1f-83b3-0cae16f471b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.760967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7941024-98d8-4a1f-83b3-0cae16f471b8 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.761337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7941024-98d8-4a1f-83b3-0cae16f471b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.761514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7941024-98d8-4a1f-83b3-0cae16f471b8 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.762643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7941024-98d8-4a1f-83b3-0cae16f471b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.764495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7941024-98d8-4a1f-83b3-0cae16f471b8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.790484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 236/470] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:06 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:06.794979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7941024-98d8-4a1f-83b3-0cae16f471b8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.888058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc50703-fb77-4477-9eb6-5094bf371267 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.933537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf114bc-48b3-487a-bc44-4a6564055268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:06.934265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf114bc-48b3-487a-bc44-4a6564055268 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:06.934554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf114bc-48b3-487a-bc44-4a6564055268 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:06.934831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf114bc-48b3-487a-bc44-4a6564055268 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:06.935608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf114bc-48b3-487a-bc44-4a6564055268 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:06.935914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf114bc-48b3-487a-bc44-4a6564055268 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:06.937308 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf114bc-48b3-487a-bc44-4a6564055268 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:06.937501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7941024-98d8-4a1f-83b3-0cae16f471b8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:06.952617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 235/471] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:06.959635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf114bc-48b3-487a-bc44-4a6564055268 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:06.992904 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:07.005741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5fc3b-a304-4544-975a-a4c0740430c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:07.006537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5fc3b-a304-4544-975a-a4c0740430c4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.006818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5fc3b-a304-4544-975a-a4c0740430c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.007137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5fc3b-a304-4544-975a-a4c0740430c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.020061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5fc3b-a304-4544-975a-a4c0740430c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:07.021644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c5fc3b-a304-4544-975a-a4c0740430c4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-c9c5fc3b-a304-4544-975a-a4c0740430c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:07.041683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:07.042584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:07.043460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:07.043460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:07.043460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:07.043460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:07.043460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 237/472] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:07.048756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5fc3b-a304-4544-975a-a4c0740430c4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:07.064222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:07.105798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf114bc-48b3-487a-bc44-4a6564055268 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:07.142978 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b4c633-5fab-46a0-b835-bd6524f0ee6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:07.143647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4c633-5fab-46a0-b835-bd6524f0ee6d None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.143928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4c633-5fab-46a0-b835-bd6524f0ee6d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.144200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b4c633-5fab-46a0-b835-bd6524f0ee6d None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.144953 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4c633-5fab-46a0-b835-bd6524f0ee6d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:07.146499 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b4c633-5fab-46a0-b835-bd6524f0ee6d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:07.173386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5fc3b-a304-4544-975a-a4c0740430c4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:07.175583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 236/473] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:06 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:05:07.177795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1de75-96bf-4aa3-af90-af91a88999e4 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.177795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1de75-96bf-4aa3-af90-af91a88999e4 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.178012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1de75-96bf-4aa3-af90-af91a88999e4 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.179501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 237/474] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:07.190137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3cc4e-fe67-4741-91d1-ea8cd45a5216 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.191578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3cc4e-fe67-4741-91d1-ea8cd45a5216 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.191945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed3cc4e-fe67-4741-91d1-ea8cd45a5216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.220068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-4ed3cc4e-fe67-4741-91d1-ea8cd45a5216 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:07.221402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4ed3cc4e-fe67-4741-91d1-ea8cd45a5216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:07.221895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf99a6-73b9-4d71-afb2-21b8d2a446f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:07.223343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf99a6-73b9-4d71-afb2-21b8d2a446f9 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.223938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf99a6-73b9-4d71-afb2-21b8d2a446f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.224337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf99a6-73b9-4d71-afb2-21b8d2a446f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.225264 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf99a6-73b9-4d71-afb2-21b8d2a446f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:07.225782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf99a6-73b9-4d71-afb2-21b8d2a446f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:07.227520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf99a6-73b9-4d71-afb2-21b8d2a446f9 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:07.250836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 238/475] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:07.256927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf99a6-73b9-4d71-afb2-21b8d2a446f9 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:07.343517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 238/476] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:07.368244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3cc4e-fe67-4741-91d1-ea8cd45a5216 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:07.371434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:07.377496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:07.416955 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf99a6-73b9-4d71-afb2-21b8d2a446f9 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:07.464000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc2a52-7faf-4801-9d83-409eddef13e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:07.464836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc2a52-7faf-4801-9d83-409eddef13e4 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.465126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc2a52-7faf-4801-9d83-409eddef13e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.465404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc2a52-7faf-4801-9d83-409eddef13e4 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.466572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc2a52-7faf-4801-9d83-409eddef13e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:07.468560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc2a52-7faf-4801-9d83-409eddef13e4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:07.488808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed3cc4e-fe67-4741-91d1-ea8cd45a5216 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:07.495407 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 239/477] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:07 2022] POST /identity/v3/users => generated 249 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:05:07.536053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe549b1e-6f2a-412e-8737-2f5cc9becb36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:07.536748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe549b1e-6f2a-412e-8737-2f5cc9becb36 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.537031 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe549b1e-6f2a-412e-8737-2f5cc9becb36 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.537305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe549b1e-6f2a-412e-8737-2f5cc9becb36 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.538086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe549b1e-6f2a-412e-8737-2f5cc9becb36 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:07.539649 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe549b1e-6f2a-412e-8737-2f5cc9becb36 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:07.548056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.sql.core [None req-fe549b1e-6f2a-412e-8737-2f5cc9becb36 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 04:05:07.548056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 04:05:07.548056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [parameters: {'id': '5c8b923802ae4a16a8b3688ae3c428f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 04:05:07.548056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80606) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-fe549b1e-6f2a-412e-8737-2f5cc9becb36 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application result.read() Jul 21 04:05:07.567120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return ref.to_dict() Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:05:07.568314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application yield resource Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise self.value Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application session.commit() Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 04:05:07.569227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self.session.flush() Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application compat.raise_( Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 04:05:07.570072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:05:07.571679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application result.read() Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:05:07.572966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [parameters: {'id': '5c8b923802ae4a16a8b3688ae3c428f7', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:07.574190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 21 04:05:07.576253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:07.578250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 239/478] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jul 21 04:05:07 2022] POST /identity/v3/roles => generated 144 bytes in 201 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:07.578386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc2a52-7faf-4801-9d83-409eddef13e4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:07.700199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc2a52-7faf-4801-9d83-409eddef13e4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:07.728155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:07.737840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eb0024-0775-4627-bee8-bf92000b8964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:07.739255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0024-0775-4627-bee8-bf92000b8964 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.739540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0024-0775-4627-bee8-bf92000b8964 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.739815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eb0024-0775-4627-bee8-bf92000b8964 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.750765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5eb0024-0775-4627-bee8-bf92000b8964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-d5eb0024-0775-4627-bee8-bf92000b8964 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:07.759647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:07.760554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:07.761519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 240/479] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:07.768469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe549b1e-6f2a-412e-8737-2f5cc9becb36 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:07.881429 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:07.919200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe549b1e-6f2a-412e-8737-2f5cc9becb36 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:07.958936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48c5de4-b804-45c8-9e76-a648aa7e5bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:07.960037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5de4-b804-45c8-9e76-a648aa7e5bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:07.960540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5de4-b804-45c8-9e76-a648aa7e5bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:07.961020 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48c5de4-b804-45c8-9e76-a648aa7e5bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:07.961974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c5de4-b804-45c8-9e76-a648aa7e5bf6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:07.962484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c5de4-b804-45c8-9e76-a648aa7e5bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:07.964463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48c5de4-b804-45c8-9e76-a648aa7e5bf6 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:07.977985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 240/480] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:09.004915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f86226-939f-49f5-bcf5-232d4dc89b0b None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.005428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f86226-939f-49f5-bcf5-232d4dc89b0b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.005537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f86226-939f-49f5-bcf5-232d4dc89b0b None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.007125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 241/481] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:09.012403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7765-a585-45f6-967c-963cef6dfea6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.012800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7765-a585-45f6-967c-963cef6dfea6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.012969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb7765-a585-45f6-967c-963cef6dfea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.030815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-53fb7765-a585-45f6-967c-963cef6dfea6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:09.032040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-53fb7765-a585-45f6-967c-963cef6dfea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:09.101739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 241/482] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:09.124718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f86226-939f-49f5-bcf5-232d4dc89b0b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:09.267705 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f86226-939f-49f5-bcf5-232d4dc89b0b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:09.309377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8a043-e551-4557-98aa-95622a71592c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:09.310526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8a043-e551-4557-98aa-95622a71592c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.311046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8a043-e551-4557-98aa-95622a71592c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.311527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8a043-e551-4557-98aa-95622a71592c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.324834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8a043-e551-4557-98aa-95622a71592c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-76c8a043-e551-4557-98aa-95622a71592c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:09.337243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:09.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:09.339217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:09.341890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 242/483] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:09.352049 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7765-a585-45f6-967c-963cef6dfea6 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:09.417475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b2d2b-1aea-4133-9b49-fb5a9a9fe9f2 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.418160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b2d2b-1aea-4133-9b49-fb5a9a9fe9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.418713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b2d2b-1aea-4133-9b49-fb5a9a9fe9f2 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.421297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 243/484] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:09.425228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4a77c-ea4d-4093-9bdf-84a866db8ff2 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.425814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4a77c-ea4d-4093-9bdf-84a866db8ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.426499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4a77c-ea4d-4093-9bdf-84a866db8ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.435344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:09.464217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-27c4a77c-ea4d-4093-9bdf-84a866db8ff2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:09.465929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-27c4a77c-ea4d-4093-9bdf-84a866db8ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:09.474455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb7765-a585-45f6-967c-963cef6dfea6 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:09.509091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b40b-fe84-4ad3-b66b-e8ecde4c2aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:09.509780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b40b-fe84-4ad3-b66b-e8ecde4c2aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.510064 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b40b-fe84-4ad3-b66b-e8ecde4c2aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.510393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b69b40b-fe84-4ad3-b66b-e8ecde4c2aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.511371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69b40b-fe84-4ad3-b66b-e8ecde4c2aa9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:09.511550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69b40b-fe84-4ad3-b66b-e8ecde4c2aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:09.512888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b69b40b-fe84-4ad3-b66b-e8ecde4c2aa9 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:09.522033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 242/485] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:09.527322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b40b-fe84-4ad3-b66b-e8ecde4c2aa9 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:09.549581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:09.603829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 244/486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:09.623722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4a77c-ea4d-4093-9bdf-84a866db8ff2 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:09.715231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b69b40b-fe84-4ad3-b66b-e8ecde4c2aa9 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:09.724556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4a77c-ea4d-4093-9bdf-84a866db8ff2 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:09.772491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:09.791694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa279ce9-ecb4-4b47-9cee-30c2f88a9bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:09.792487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa279ce9-ecb4-4b47-9cee-30c2f88a9bdd None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.792771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa279ce9-ecb4-4b47-9cee-30c2f88a9bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.793044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa279ce9-ecb4-4b47-9cee-30c2f88a9bdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.794175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea5c24-e924-4a51-a669-4513708662e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:09.794976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea5c24-e924-4a51-a669-4513708662e0 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:09.795252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea5c24-e924-4a51-a669-4513708662e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:09.795527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea5c24-e924-4a51-a669-4513708662e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:09.811917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa279ce9-ecb4-4b47-9cee-30c2f88a9bdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:09.813565 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa279ce9-ecb4-4b47-9cee-30c2f88a9bdd None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:09.820411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea5c24-e924-4a51-a669-4513708662e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f4ea5c24-e924-4a51-a669-4513708662e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:09.828460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:09.829352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:09.830593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 245/487] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:09.836615 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea5c24-e924-4a51-a669-4513708662e0 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-fa279ce9-ecb4-4b47-9cee-30c2f88a9bdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:09.851631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:09.852734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:09.854550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:09.854550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:09.854550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:09.854550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:09.854550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 243/488] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:09.862520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa279ce9-ecb4-4b47-9cee-30c2f88a9bdd None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:09.905375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:09.989530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea5c24-e924-4a51-a669-4513708662e0 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.026166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b2db2-5db1-4ae7-8f12-1469fd7c2bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.026907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2db2-5db1-4ae7-8f12-1469fd7c2bce None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.027099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2db2-5db1-4ae7-8f12-1469fd7c2bce None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.027309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b2db2-5db1-4ae7-8f12-1469fd7c2bce None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.028058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b2db2-5db1-4ae7-8f12-1469fd7c2bce None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:10.028638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b2db2-5db1-4ae7-8f12-1469fd7c2bce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.030967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b2db2-5db1-4ae7-8f12-1469fd7c2bce None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.040555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 246/489] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:10.046015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b2db2-5db1-4ae7-8f12-1469fd7c2bce None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.097331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa279ce9-ecb4-4b47-9cee-30c2f88a9bdd None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.145130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d64c6b-2999-43dd-9f09-b1c9b05f57c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.145792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64c6b-2999-43dd-9f09-b1c9b05f57c9 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.146072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64c6b-2999-43dd-9f09-b1c9b05f57c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.146342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d64c6b-2999-43dd-9f09-b1c9b05f57c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.147090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64c6b-2999-43dd-9f09-b1c9b05f57c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:10.147394 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64c6b-2999-43dd-9f09-b1c9b05f57c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.149235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d64c6b-2999-43dd-9f09-b1c9b05f57c9 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.166078 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 244/490] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:10.170426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.172134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb47d-e188-4f20-bc3f-602b0839f56a None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.172324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb47d-e188-4f20-bc3f-602b0839f56a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.172605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbeb47d-e188-4f20-bc3f-602b0839f56a None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.178262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 245/491] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:10.178262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb47d-e188-4f20-bc3f-602b0839f56a None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.180155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b2db2-5db1-4ae7-8f12-1469fd7c2bce None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.218612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934a7284-8620-4200-8506-f70d42b4aa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.219764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a7284-8620-4200-8506-f70d42b4aa30 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.220197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a7284-8620-4200-8506-f70d42b4aa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.220624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934a7284-8620-4200-8506-f70d42b4aa30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.226596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.240324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a7284-8620-4200-8506-f70d42b4aa30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.242120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934a7284-8620-4200-8506-f70d42b4aa30 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-934a7284-8620-4200-8506-f70d42b4aa30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:10.264248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:10.265353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:10.266304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:10.266304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:10.266304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:10.266304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:10.268354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 247/492] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:10.270232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbbcd-7348-484b-be75-ce00153a482f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.270761 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbbcd-7348-484b-be75-ce00153a482f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.271243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860dbbcd-7348-484b-be75-ce00153a482f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.289686 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-860dbbcd-7348-484b-be75-ce00153a482f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:10.291219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-860dbbcd-7348-484b-be75-ce00153a482f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:10.310905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbeb47d-e188-4f20-bc3f-602b0839f56a None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.348109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3880c54-0fde-4708-be4e-b85020fabe6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.349090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3880c54-0fde-4708-be4e-b85020fabe6a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.349370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3880c54-0fde-4708-be4e-b85020fabe6a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.349646 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3880c54-0fde-4708-be4e-b85020fabe6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.357443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3880c54-0fde-4708-be4e-b85020fabe6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.358887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3880c54-0fde-4708-be4e-b85020fabe6a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.371296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 248/493] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:10.372526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dbbcd-7348-484b-be75-ce00153a482f None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f3880c54-0fde-4708-be4e-b85020fabe6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:10.374690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:10.375802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:10.376720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 246/494] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:10.377731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30388-4901-4b20-8b99-e9534b55ad47 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.377731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30388-4901-4b20-8b99-e9534b55ad47 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.377891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc30388-4901-4b20-8b99-e9534b55ad47 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.383598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 247/495] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:10.383598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc30388-4901-4b20-8b99-e9534b55ad47 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.471345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.485006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.493296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860dbbcd-7348-484b-be75-ce00153a482f None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.493431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc30388-4901-4b20-8b99-e9534b55ad47 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.527745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf310b3f-6f4d-46d5-9611-372c0467e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.528405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310b3f-6f4d-46d5-9611-372c0467e874 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.528688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310b3f-6f4d-46d5-9611-372c0467e874 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.528958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf310b3f-6f4d-46d5-9611-372c0467e874 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.529671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf310b3f-6f4d-46d5-9611-372c0467e874 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:10.529971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf310b3f-6f4d-46d5-9611-372c0467e874 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.531096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064458b1-8aaf-4ae0-820b-179f9b5b389a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.531382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf310b3f-6f4d-46d5-9611-372c0467e874 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.531764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064458b1-8aaf-4ae0-820b-179f9b5b389a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.532053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064458b1-8aaf-4ae0-820b-179f9b5b389a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.532332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064458b1-8aaf-4ae0-820b-179f9b5b389a None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.533365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064458b1-8aaf-4ae0-820b-179f9b5b389a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:10.534146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064458b1-8aaf-4ae0-820b-179f9b5b389a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.535724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064458b1-8aaf-4ae0-820b-179f9b5b389a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.543258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 249/496] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:10.548349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095327d0-0fe1-4042-9772-d776f0ace2b6 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.548640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095327d0-0fe1-4042-9772-d776f0ace2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.548922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095327d0-0fe1-4042-9772-d776f0ace2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.568786 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-095327d0-0fe1-4042-9772-d776f0ace2b6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:10.569991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-095327d0-0fe1-4042-9772-d776f0ace2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:10.589011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 248/497] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:10.589011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064458b1-8aaf-4ae0-820b-179f9b5b389a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.647566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 250/498] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:10.648240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095327d0-0fe1-4042-9772-d776f0ace2b6 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.729355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064458b1-8aaf-4ae0-820b-179f9b5b389a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.750945 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.781983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4924a0c-f2c4-46d4-8bfd-abe6794ff750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.783265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4924a0c-f2c4-46d4-8bfd-abe6794ff750 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.783748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4924a0c-f2c4-46d4-8bfd-abe6794ff750 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.784189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4924a0c-f2c4-46d4-8bfd-abe6794ff750 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.799601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095327d0-0fe1-4042-9772-d776f0ace2b6 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.799999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4924a0c-f2c4-46d4-8bfd-abe6794ff750 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f4924a0c-f2c4-46d4-8bfd-abe6794ff750 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:10.814331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:10.815407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 249/499] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:10.821235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4924a0c-f2c4-46d4-8bfd-abe6794ff750 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.835800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:10.848830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bba557-d3ba-4a35-b0f5-796ea6a8dbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.849619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bba557-d3ba-4a35-b0f5-796ea6a8dbe5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.849898 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bba557-d3ba-4a35-b0f5-796ea6a8dbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.850180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bba557-d3ba-4a35-b0f5-796ea6a8dbe5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.857384 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bba557-d3ba-4a35-b0f5-796ea6a8dbe5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:10.858853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bba557-d3ba-4a35-b0f5-796ea6a8dbe5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-96bba557-d3ba-4a35-b0f5-796ea6a8dbe5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:10.875523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:10.876570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 251/500] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:10.877600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bba557-d3ba-4a35-b0f5-796ea6a8dbe5 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:10.924083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4924a0c-f2c4-46d4-8bfd-abe6794ff750 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:10.956790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f90668-630b-4bfb-b0d1-99cbb0733b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:10.957439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90668-630b-4bfb-b0d1-99cbb0733b3d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:10.957714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90668-630b-4bfb-b0d1-99cbb0733b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:10.957985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f90668-630b-4bfb-b0d1-99cbb0733b3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:10.978406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bba557-d3ba-4a35-b0f5-796ea6a8dbe5 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.008022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.014722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b70d52-e243-4f4b-8481-457220516210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.015542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b70d52-e243-4f4b-8481-457220516210 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.015827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b70d52-e243-4f4b-8481-457220516210 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.016099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b70d52-e243-4f4b-8481-457220516210 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.025899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f90668-630b-4bfb-b0d1-99cbb0733b3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.026860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b70d52-e243-4f4b-8481-457220516210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:11.027428 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f90668-630b-4bfb-b0d1-99cbb0733b3d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-95b70d52-e243-4f4b-8481-457220516210 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:11.034602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:11.036102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:11.036888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 252/501] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:11.038156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b92f4-b0c7-43a8-a538-e1af3d89f8f3 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.038457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b92f4-b0c7-43a8-a538-e1af3d89f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.038718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b92f4-b0c7-43a8-a538-e1af3d89f8f3 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.040017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 253/502] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:11.040714 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b92f4-b0c7-43a8-a538-e1af3d89f8f3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.046980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.131235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 250/503] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:11.132098 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f90668-630b-4bfb-b0d1-99cbb0733b3d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.141107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b92f4-b0c7-43a8-a538-e1af3d89f8f3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.173976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dab37-bbdf-4daf-9707-1a49b9814e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.174627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dab37-bbdf-4daf-9707-1a49b9814e5c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.174909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dab37-bbdf-4daf-9707-1a49b9814e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.175215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9dab37-bbdf-4daf-9707-1a49b9814e5c None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.176495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dab37-bbdf-4daf-9707-1a49b9814e5c None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:11.176787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dab37-bbdf-4daf-9707-1a49b9814e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.178179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9dab37-bbdf-4daf-9707-1a49b9814e5c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.188545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 254/504] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:11.189351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dab37-bbdf-4daf-9707-1a49b9814e5c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.234374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f90668-630b-4bfb-b0d1-99cbb0733b3d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.242480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.249259 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.270669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ad338-8116-4968-8f86-b2c77fc3ffb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.271370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad338-8116-4968-8f86-b2c77fc3ffb8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.271651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad338-8116-4968-8f86-b2c77fc3ffb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.271927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ad338-8116-4968-8f86-b2c77fc3ffb8 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.272757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ad338-8116-4968-8f86-b2c77fc3ffb8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:11.273061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ad338-8116-4968-8f86-b2c77fc3ffb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.274483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ad338-8116-4968-8f86-b2c77fc3ffb8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.290245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9dab37-bbdf-4daf-9707-1a49b9814e5c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.291105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 251/505] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:11.292305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef073487-b932-4d51-861b-0ce88bfee06c None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.292588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef073487-b932-4d51-861b-0ce88bfee06c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.292860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef073487-b932-4d51-861b-0ce88bfee06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.309155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-ef073487-b932-4d51-861b-0ce88bfee06c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:11.310335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ef073487-b932-4d51-861b-0ce88bfee06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:11.325214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e9a1-4fbd-4fc3-8863-cdde9babb7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.325884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e9a1-4fbd-4fc3-8863-cdde9babb7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.326163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e9a1-4fbd-4fc3-8863-cdde9babb7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.326436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e9a1-4fbd-4fc3-8863-cdde9babb7e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.327215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e9a1-4fbd-4fc3-8863-cdde9babb7e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:11.327520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e9a1-4fbd-4fc3-8863-cdde9babb7e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.328907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e9a1-4fbd-4fc3-8863-cdde9babb7e4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.336729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 255/506] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:11.337502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e9a1-4fbd-4fc3-8863-cdde9babb7e4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.376860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 252/507] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:11.377876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef073487-b932-4d51-861b-0ce88bfee06c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.436793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e9a1-4fbd-4fc3-8863-cdde9babb7e4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.450614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.471394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1d5f9-e8fe-4cca-91a2-b6a1097635c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.472173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1d5f9-e8fe-4cca-91a2-b6a1097635c6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.472493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1d5f9-e8fe-4cca-91a2-b6a1097635c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.472771 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef1d5f9-e8fe-4cca-91a2-b6a1097635c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.482800 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1d5f9-e8fe-4cca-91a2-b6a1097635c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.484280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef1d5f9-e8fe-4cca-91a2-b6a1097635c6 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.488829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef073487-b932-4d51-861b-0ce88bfee06c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.490349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-7ef1d5f9-e8fe-4cca-91a2-b6a1097635c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:11.502303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:11.503380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:11.509733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:11.509733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:11.509733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:11.509733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:11.509733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 256/508] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:11.509733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1d5f9-e8fe-4cca-91a2-b6a1097635c6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.525779 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5fef8-0de1-4e5c-9a6d-5b6fc03a97c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.526569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5fef8-0de1-4e5c-9a6d-5b6fc03a97c9 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.526852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5fef8-0de1-4e5c-9a6d-5b6fc03a97c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.527167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5fef8-0de1-4e5c-9a6d-5b6fc03a97c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.537201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5fef8-0de1-4e5c-9a6d-5b6fc03a97c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.538677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5fef8-0de1-4e5c-9a6d-5b6fc03a97c9 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-89e5fef8-0de1-4e5c-9a6d-5b6fc03a97c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:11.556167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:11.557201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:11.558089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:11.558089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:11.558089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:11.558089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:11.558089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 253/509] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:11.558521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5fef8-0de1-4e5c-9a6d-5b6fc03a97c9 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.610212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef1d5f9-e8fe-4cca-91a2-b6a1097635c6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.642801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57275b48-51c0-483a-83c6-47a5b61afcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.643561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57275b48-51c0-483a-83c6-47a5b61afcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.643845 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57275b48-51c0-483a-83c6-47a5b61afcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.644118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57275b48-51c0-483a-83c6-47a5b61afcf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.657191 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5fef8-0de1-4e5c-9a6d-5b6fc03a97c9 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.678600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.691959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614c3dc-c364-4824-bc80-3ad3451aa94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.692668 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614c3dc-c364-4824-bc80-3ad3451aa94b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.692950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614c3dc-c364-4824-bc80-3ad3451aa94b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.693223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c614c3dc-c364-4824-bc80-3ad3451aa94b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.703589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614c3dc-c364-4824-bc80-3ad3451aa94b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.705102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c614c3dc-c364-4824-bc80-3ad3451aa94b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.712016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57275b48-51c0-483a-83c6-47a5b61afcf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.713742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57275b48-51c0-483a-83c6-47a5b61afcf4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-c614c3dc-c364-4824-bc80-3ad3451aa94b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:11.723288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:11.724133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:11.725010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:11.725010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:11.725010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:11.725010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:11.725010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 254/510] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:11.725280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614c3dc-c364-4824-bc80-3ad3451aa94b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.734295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.814632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 257/511] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:11.815501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57275b48-51c0-483a-83c6-47a5b61afcf4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.825533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c614c3dc-c364-4824-bc80-3ad3451aa94b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.861053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c742b77-9abf-45a6-b097-2624d2abec78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.861849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c742b77-9abf-45a6-b097-2624d2abec78 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.862131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c742b77-9abf-45a6-b097-2624d2abec78 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.862405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c742b77-9abf-45a6-b097-2624d2abec78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.873167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c742b77-9abf-45a6-b097-2624d2abec78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.874655 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c742b77-9abf-45a6-b097-2624d2abec78 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.881160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-8c742b77-9abf-45a6-b097-2624d2abec78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:11.891722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:11.892772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:11.893804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:11.893804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:11.893804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:11.893804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:11.893804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 255/512] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:11.893804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c742b77-9abf-45a6-b097-2624d2abec78 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.919196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57275b48-51c0-483a-83c6-47a5b61afcf4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:11.951551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:11.953413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864a2ff-12a8-457c-8234-94f76d6c6c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:11.954238 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864a2ff-12a8-457c-8234-94f76d6c6c57 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:11.954518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864a2ff-12a8-457c-8234-94f76d6c6c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:11.954798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c864a2ff-12a8-457c-8234-94f76d6c6c57 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:11.955549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864a2ff-12a8-457c-8234-94f76d6c6c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:11.955851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864a2ff-12a8-457c-8234-94f76d6c6c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:11.957890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c864a2ff-12a8-457c-8234-94f76d6c6c57 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:11.969081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 258/513] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:11.969868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864a2ff-12a8-457c-8234-94f76d6c6c57 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:11.995208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c742b77-9abf-45a6-b097-2624d2abec78 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.028323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00dc5d-74c9-4945-b3fc-16e694733641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.028973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00dc5d-74c9-4945-b3fc-16e694733641 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.029254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00dc5d-74c9-4945-b3fc-16e694733641 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.029528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00dc5d-74c9-4945-b3fc-16e694733641 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.030244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00dc5d-74c9-4945-b3fc-16e694733641 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.030548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00dc5d-74c9-4945-b3fc-16e694733641 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.031965 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00dc5d-74c9-4945-b3fc-16e694733641 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.043919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 256/514] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.044706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00dc5d-74c9-4945-b3fc-16e694733641 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.073406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c864a2ff-12a8-457c-8234-94f76d6c6c57 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.098743 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.107307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325de7f8-42a5-4b26-8aca-aff4f5b26c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.107962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325de7f8-42a5-4b26-8aca-aff4f5b26c61 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.108241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325de7f8-42a5-4b26-8aca-aff4f5b26c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.108515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325de7f8-42a5-4b26-8aca-aff4f5b26c61 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.109225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325de7f8-42a5-4b26-8aca-aff4f5b26c61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.109527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325de7f8-42a5-4b26-8aca-aff4f5b26c61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.110897 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325de7f8-42a5-4b26-8aca-aff4f5b26c61 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.122438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 259/515] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.123245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325de7f8-42a5-4b26-8aca-aff4f5b26c61 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.145093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00dc5d-74c9-4945-b3fc-16e694733641 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.162946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.179635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39f9d-4022-4766-8aa1-d51c516ac265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.182913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39f9d-4022-4766-8aa1-d51c516ac265 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.182913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39f9d-4022-4766-8aa1-d51c516ac265 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.182913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c39f9d-4022-4766-8aa1-d51c516ac265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.190865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39f9d-4022-4766-8aa1-d51c516ac265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.192856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c39f9d-4022-4766-8aa1-d51c516ac265 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f8c39f9d-4022-4766-8aa1-d51c516ac265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:12.212393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:12.213701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:12.219185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:12.219185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:12.219185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:12.219185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:12.219185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 257/516] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:12.219185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39f9d-4022-4766-8aa1-d51c516ac265 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.227112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325de7f8-42a5-4b26-8aca-aff4f5b26c61 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.261228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda96784-16f2-4356-b691-03db41aa782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.261962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda96784-16f2-4356-b691-03db41aa782e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.262247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda96784-16f2-4356-b691-03db41aa782e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.262518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda96784-16f2-4356-b691-03db41aa782e None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.263260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda96784-16f2-4356-b691-03db41aa782e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.263561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda96784-16f2-4356-b691-03db41aa782e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.264941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda96784-16f2-4356-b691-03db41aa782e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.275926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 260/517] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.276719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda96784-16f2-4356-b691-03db41aa782e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.314197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c39f9d-4022-4766-8aa1-d51c516ac265 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.323918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.349217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99118c-ea22-40a1-9d29-0179d00f3ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.350007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99118c-ea22-40a1-9d29-0179d00f3ead None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.350292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99118c-ea22-40a1-9d29-0179d00f3ead None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.350571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f99118c-ea22-40a1-9d29-0179d00f3ead None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.357319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99118c-ea22-40a1-9d29-0179d00f3ead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.359065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f99118c-ea22-40a1-9d29-0179d00f3ead None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-8f99118c-ea22-40a1-9d29-0179d00f3ead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:12.373802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:12.374811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:12.375810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:12.375810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:12.375810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:12.375810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:12.375810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:12.375810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:12.375810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:12.375810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:12.375810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 258/518] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:12.375810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99118c-ea22-40a1-9d29-0179d00f3ead None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.379440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda96784-16f2-4356-b691-03db41aa782e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.405815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.414041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1232a-d9ea-4625-b1f5-29235daf999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.414825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1232a-d9ea-4625-b1f5-29235daf999c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.415138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1232a-d9ea-4625-b1f5-29235daf999c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.415412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa1232a-d9ea-4625-b1f5-29235daf999c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.422873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1232a-d9ea-4625-b1f5-29235daf999c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.424411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa1232a-d9ea-4625-b1f5-29235daf999c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-0aa1232a-d9ea-4625-b1f5-29235daf999c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:12.438922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:12.439855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:12.440746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 261/519] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:12.442102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1232a-d9ea-4625-b1f5-29235daf999c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.482759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f99118c-ea22-40a1-9d29-0179d00f3ead None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.515588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181a8c2-6374-43d1-ba2f-c4852b611f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.516379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181a8c2-6374-43d1-ba2f-c4852b611f67 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.516655 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181a8c2-6374-43d1-ba2f-c4852b611f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.516927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181a8c2-6374-43d1-ba2f-c4852b611f67 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.525021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181a8c2-6374-43d1-ba2f-c4852b611f67 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.526471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181a8c2-6374-43d1-ba2f-c4852b611f67 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0181a8c2-6374-43d1-ba2f-c4852b611f67 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:12.541087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:12.542166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:12.543113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 259/520] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:12.543668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa1232a-d9ea-4625-b1f5-29235daf999c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.543739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181a8c2-6374-43d1-ba2f-c4852b611f67 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.549948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.580025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d640af-f093-40d8-ab64-696ddbc5aa88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.580686 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d640af-f093-40d8-ab64-696ddbc5aa88 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.580969 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d640af-f093-40d8-ab64-696ddbc5aa88 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.581243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d640af-f093-40d8-ab64-696ddbc5aa88 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.582162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d640af-f093-40d8-ab64-696ddbc5aa88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.582506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d640af-f093-40d8-ab64-696ddbc5aa88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.583922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d640af-f093-40d8-ab64-696ddbc5aa88 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.595814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 262/521] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.596597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d640af-f093-40d8-ab64-696ddbc5aa88 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.636203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.649610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181a8c2-6374-43d1-ba2f-c4852b611f67 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.682616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011d15-7465-498d-b6ab-09726e199875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.683316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011d15-7465-498d-b6ab-09726e199875 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.683604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011d15-7465-498d-b6ab-09726e199875 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.683887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65011d15-7465-498d-b6ab-09726e199875 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.684584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011d15-7465-498d-b6ab-09726e199875 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.686033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65011d15-7465-498d-b6ab-09726e199875 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.695062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d640af-f093-40d8-ab64-696ddbc5aa88 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.705418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 260/522] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:12 2022] POST /identity/v3/users => generated 247 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:12.706469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011d15-7465-498d-b6ab-09726e199875 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.746186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f72fb6-7c62-47be-af21-321c8e7fba8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.746760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f72fb6-7c62-47be-af21-321c8e7fba8b None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.747078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f72fb6-7c62-47be-af21-321c8e7fba8b None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.747358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f72fb6-7c62-47be-af21-321c8e7fba8b None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.748164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f72fb6-7c62-47be-af21-321c8e7fba8b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.748480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f72fb6-7c62-47be-af21-321c8e7fba8b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.749982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f72fb6-7c62-47be-af21-321c8e7fba8b None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.775430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 263/523] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.775430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f72fb6-7c62-47be-af21-321c8e7fba8b None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.803783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.832538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65011d15-7465-498d-b6ab-09726e199875 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.871698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc09a9-e83c-4f59-b69c-e878f7aa7a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.872367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc09a9-e83c-4f59-b69c-e878f7aa7a25 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.872656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc09a9-e83c-4f59-b69c-e878f7aa7a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.872928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc09a9-e83c-4f59-b69c-e878f7aa7a25 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.873765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc09a9-e83c-4f59-b69c-e878f7aa7a25 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.874068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc09a9-e83c-4f59-b69c-e878f7aa7a25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.875544 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc09a9-e83c-4f59-b69c-e878f7aa7a25 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.890071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f72fb6-7c62-47be-af21-321c8e7fba8b None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:12.896252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 261/524] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.897005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc09a9-e83c-4f59-b69c-e878f7aa7a25 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:12.900913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:12.934583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bfff-7252-4c58-9fe4-fe78a28e0fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:12.935281 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bfff-7252-4c58-9fe4-fe78a28e0fb8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:12.935565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bfff-7252-4c58-9fe4-fe78a28e0fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:12.935838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d8bfff-7252-4c58-9fe4-fe78a28e0fb8 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:12.936737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8bfff-7252-4c58-9fe4-fe78a28e0fb8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:12.937070 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8bfff-7252-4c58-9fe4-fe78a28e0fb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:12.938528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d8bfff-7252-4c58-9fe4-fe78a28e0fb8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:12.976811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 264/525] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:12.979156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bfff-7252-4c58-9fe4-fe78a28e0fb8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.013356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc09a9-e83c-4f59-b69c-e878f7aa7a25 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.049037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb472ca8-e8f0-4dc8-a8a8-a4e3089b832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.049898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb472ca8-e8f0-4dc8-a8a8-a4e3089b832b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.050182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb472ca8-e8f0-4dc8-a8a8-a4e3089b832b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.050628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb472ca8-e8f0-4dc8-a8a8-a4e3089b832b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.058311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb472ca8-e8f0-4dc8-a8a8-a4e3089b832b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.059984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb472ca8-e8f0-4dc8-a8a8-a4e3089b832b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-fb472ca8-e8f0-4dc8-a8a8-a4e3089b832b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:13.073897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:13.074757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:13.080403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:13.080403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:13.080403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:13.080403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:13.080403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:13.080403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:13.080403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:13.080403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:13.080403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 262/526] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:13.080403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb472ca8-e8f0-4dc8-a8a8-a4e3089b832b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.081696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.100401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d8bfff-7252-4c58-9fe4-fe78a28e0fb8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.135428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139f6e3-3359-4953-813e-361960f1a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.136078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139f6e3-3359-4953-813e-361960f1a969 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.136361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139f6e3-3359-4953-813e-361960f1a969 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.136642 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7139f6e3-3359-4953-813e-361960f1a969 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.137469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139f6e3-3359-4953-813e-361960f1a969 None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=5a82fed4ff8845919b1da05f7e8d1d72) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:13.137779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139f6e3-3359-4953-813e-361960f1a969 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.139270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7139f6e3-3359-4953-813e-361960f1a969 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.151698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.152230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 265/527] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:12 2022] GET /identity/v3/role_assignments?user.id=5a82fed4ff8845919b1da05f7e8d1d72&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:13.153664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139f6e3-3359-4953-813e-361960f1a969 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.223361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb472ca8-e8f0-4dc8-a8a8-a4e3089b832b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.274917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b13235-b303-4d9f-9723-7c3fbcd9fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.276181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b13235-b303-4d9f-9723-7c3fbcd9fb1f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.276614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b13235-b303-4d9f-9723-7c3fbcd9fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.277056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b13235-b303-4d9f-9723-7c3fbcd9fb1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.294215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7139f6e3-3359-4953-813e-361960f1a969 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.341975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a03aac-3c41-49e1-82ea-888f50c456bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.342790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03aac-3c41-49e1-82ea-888f50c456bd None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.343224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03aac-3c41-49e1-82ea-888f50c456bd None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.343605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a03aac-3c41-49e1-82ea-888f50c456bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.362577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.370587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b13235-b303-4d9f-9723-7c3fbcd9fb1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.372304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b13235-b303-4d9f-9723-7c3fbcd9fb1f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.416288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a03aac-3c41-49e1-82ea-888f50c456bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.417995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a03aac-3c41-49e1-82ea-888f50c456bd None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.443065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.491028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 263/528] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:13.492269 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b13235-b303-4d9f-9723-7c3fbcd9fb1f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.530430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 266/529] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:13.530430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a03aac-3c41-49e1-82ea-888f50c456bd None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.578196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.605348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b13235-b303-4d9f-9723-7c3fbcd9fb1f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.639965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a03aac-3c41-49e1-82ea-888f50c456bd None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.645571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a4f5b-7be4-4585-a566-9f3c7021e0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.646589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a4f5b-7be4-4585-a566-9f3c7021e0de None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.647075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a4f5b-7be4-4585-a566-9f3c7021e0de None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.647495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a4f5b-7be4-4585-a566-9f3c7021e0de None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.648446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a4f5b-7be4-4585-a566-9f3c7021e0de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:13.648897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a4f5b-7be4-4585-a566-9f3c7021e0de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.650471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a4f5b-7be4-4585-a566-9f3c7021e0de None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.670037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 264/530] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:13.671230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a4f5b-7be4-4585-a566-9f3c7021e0de None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.680423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b29b9-58e6-4ed1-bd61-b5a19ff2ca96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.681870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b29b9-58e6-4ed1-bd61-b5a19ff2ca96 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.682253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b29b9-58e6-4ed1-bd61-b5a19ff2ca96 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.682635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b29b9-58e6-4ed1-bd61-b5a19ff2ca96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.697423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b29b9-58e6-4ed1-bd61-b5a19ff2ca96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.699396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b29b9-58e6-4ed1-bd61-b5a19ff2ca96 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.700184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-447b29b9-58e6-4ed1-bd61-b5a19ff2ca96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:13.734156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:13.735289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:13.736334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:13.736334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:13.736334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:13.736334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:13.741301 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 267/531] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:13.742253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b29b9-58e6-4ed1-bd61-b5a19ff2ca96 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.797935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a4f5b-7be4-4585-a566-9f3c7021e0de None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.835155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eed1b-5b2c-47dd-b069-1ac2f051ef38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.836186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eed1b-5b2c-47dd-b069-1ac2f051ef38 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.836652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eed1b-5b2c-47dd-b069-1ac2f051ef38 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.837067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eed1b-5b2c-47dd-b069-1ac2f051ef38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.847760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:13.849449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eed1b-5b2c-47dd-b069-1ac2f051ef38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.851115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eed1b-5b2c-47dd-b069-1ac2f051ef38 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.851382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b29b9-58e6-4ed1-bd61-b5a19ff2ca96 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-e24eed1b-5b2c-47dd-b069-1ac2f051ef38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:13.875080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:13.876173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:13.877222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:13.877222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:13.877222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:13.877222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:13.879364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 265/532] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:13.884570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eed1b-5b2c-47dd-b069-1ac2f051ef38 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.892665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87634053-c846-431e-8728-8e5084a4116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:13.893441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87634053-c846-431e-8728-8e5084a4116d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:13.893818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87634053-c846-431e-8728-8e5084a4116d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:13.894190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87634053-c846-431e-8728-8e5084a4116d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:13.896027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87634053-c846-431e-8728-8e5084a4116d None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=92407a5a276247e79d2abe41fee54c33) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:13.896250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87634053-c846-431e-8728-8e5084a4116d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:13.897810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87634053-c846-431e-8728-8e5084a4116d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:13.904196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 268/533] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/role_assignments?user.id=92407a5a276247e79d2abe41fee54c33&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:13.905206 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87634053-c846-431e-8728-8e5084a4116d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:13.974306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:14.002011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eed1b-5b2c-47dd-b069-1ac2f051ef38 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.016505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87634053-c846-431e-8728-8e5084a4116d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.041836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516e12-cbcb-42f7-bbee-1a30fdf8d3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.042793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516e12-cbcb-42f7-bbee-1a30fdf8d3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.043242 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516e12-cbcb-42f7-bbee-1a30fdf8d3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.043650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516e12-cbcb-42f7-bbee-1a30fdf8d3a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.044557 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516e12-cbcb-42f7-bbee-1a30fdf8d3a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:14.045006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516e12-cbcb-42f7-bbee-1a30fdf8d3a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.046574 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516e12-cbcb-42f7-bbee-1a30fdf8d3a0 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.056844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca0c6c-7314-491b-8d83-2695e9e7dde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.057575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca0c6c-7314-491b-8d83-2695e9e7dde9 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.057954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca0c6c-7314-491b-8d83-2695e9e7dde9 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.058341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ca0c6c-7314-491b-8d83-2695e9e7dde9 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.059225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca0c6c-7314-491b-8d83-2695e9e7dde9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:14.059632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca0c6c-7314-491b-8d83-2695e9e7dde9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.061133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ca0c6c-7314-491b-8d83-2695e9e7dde9 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.062635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 266/534] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:14.070709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516e12-cbcb-42f7-bbee-1a30fdf8d3a0 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.087016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 269/535] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:14.087016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca0c6c-7314-491b-8d83-2695e9e7dde9 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.116711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:14.258867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ca0c6c-7314-491b-8d83-2695e9e7dde9 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.271007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516e12-cbcb-42f7-bbee-1a30fdf8d3a0 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.320358 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13141-9700-4f4d-a540-bdeeb7b00d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.321248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13141-9700-4f4d-a540-bdeeb7b00d1c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.321535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13141-9700-4f4d-a540-bdeeb7b00d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.321809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13141-9700-4f4d-a540-bdeeb7b00d1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.328134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:14.334095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa39dd-1fbb-4a80-abc9-815c194e9664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.335289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa39dd-1fbb-4a80-abc9-815c194e9664 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.335785 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa39dd-1fbb-4a80-abc9-815c194e9664 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.336270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa39dd-1fbb-4a80-abc9-815c194e9664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.340045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb13141-9700-4f4d-a540-bdeeb7b00d1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.345903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb13141-9700-4f4d-a540-bdeeb7b00d1c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.351014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa39dd-1fbb-4a80-abc9-815c194e9664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.352759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaa39dd-1fbb-4a80-abc9-815c194e9664 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-dfb13141-9700-4f4d-a540-bdeeb7b00d1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:14.366339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:14.367486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:14.368334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:14.368334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:14.368334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:14.368334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:14.368334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:14.368334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:14.368334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:14.368334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:14.384192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 267/536] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-3eaa39dd-1fbb-4a80-abc9-815c194e9664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:14.384572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:14.385460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:14.386309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:14.386309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:14.386309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:14.386309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:14.386309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:14.386309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:14.386309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:14.386309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:14.393018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 270/537] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:14.399378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13141-9700-4f4d-a540-bdeeb7b00d1c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.409602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa39dd-1fbb-4a80-abc9-815c194e9664 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.555841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:14.574855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa39dd-1fbb-4a80-abc9-815c194e9664 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.609317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13141-9700-4f4d-a540-bdeeb7b00d1c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.616567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b85288-b95a-45b8-82a5-66b982b58c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.617242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b85288-b95a-45b8-82a5-66b982b58c17 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.617528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b85288-b95a-45b8-82a5-66b982b58c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.617804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b85288-b95a-45b8-82a5-66b982b58c17 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.618599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b85288-b95a-45b8-82a5-66b982b58c17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:14.618919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b85288-b95a-45b8-82a5-66b982b58c17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.620378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b85288-b95a-45b8-82a5-66b982b58c17 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.643647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 271/538] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:14.649906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b85288-b95a-45b8-82a5-66b982b58c17 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.673260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa1dba-4919-447d-b266-3d2ffc0551b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.673932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1dba-4919-447d-b266-3d2ffc0551b8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.674220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1dba-4919-447d-b266-3d2ffc0551b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.674497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa1dba-4919-447d-b266-3d2ffc0551b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.675346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1dba-4919-447d-b266-3d2ffc0551b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:14.675708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1dba-4919-447d-b266-3d2ffc0551b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.677165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa1dba-4919-447d-b266-3d2ffc0551b8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.699131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 268/539] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:14.704895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa1dba-4919-447d-b266-3d2ffc0551b8 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:14.814784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:14.822105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b85288-b95a-45b8-82a5-66b982b58c17 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.890304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fabed-462b-405c-aaf4-27d1b4aeb57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.891049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fabed-462b-405c-aaf4-27d1b4aeb57b None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.891340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fabed-462b-405c-aaf4-27d1b4aeb57b None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.891740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fabed-462b-405c-aaf4-27d1b4aeb57b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.892581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fabed-462b-405c-aaf4-27d1b4aeb57b None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=e210e10ee6b649399de11ac719a89718) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:14.892891 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fabed-462b-405c-aaf4-27d1b4aeb57b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.894596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fabed-462b-405c-aaf4-27d1b4aeb57b None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.898386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa1dba-4919-447d-b266-3d2ffc0551b8 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:14.907404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 272/540] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/role_assignments?user.id=e210e10ee6b649399de11ac719a89718&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:14.909044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f29ac-5b7d-407a-b9bd-1d23b8cac1b4 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.909336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f29ac-5b7d-407a-b9bd-1d23b8cac1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.909612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f29ac-5b7d-407a-b9bd-1d23b8cac1b4 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.911431 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 273/541] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:14.926019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67511-cd05-4147-b06e-b82c535382e2 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.926317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67511-cd05-4147-b06e-b82c535382e2 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.926599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a67511-cd05-4147-b06e-b82c535382e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.936224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952635f-09bd-49d3-82bb-ce99dfafa307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:14.937271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952635f-09bd-49d3-82bb-ce99dfafa307 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:14.937722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952635f-09bd-49d3-82bb-ce99dfafa307 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:14.938135 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952635f-09bd-49d3-82bb-ce99dfafa307 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:14.939190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952635f-09bd-49d3-82bb-ce99dfafa307 None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=b3b2d5dee6d240558a71331e05035a30) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:14.939647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952635f-09bd-49d3-82bb-ce99dfafa307 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:14.943058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952635f-09bd-49d3-82bb-ce99dfafa307 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:14.954547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 269/542] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:14 2022] GET /identity/v3/role_assignments?user.id=b3b2d5dee6d240558a71331e05035a30&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:14.963781 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c9a67511-cd05-4147-b06e-b82c535382e2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:14.965018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c9a67511-cd05-4147-b06e-b82c535382e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:14.967250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:15.069045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 274/543] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:15.093276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952635f-09bd-49d3-82bb-ce99dfafa307 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:15.222245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952635f-09bd-49d3-82bb-ce99dfafa307 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.251139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:15.272202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85154e58-2860-4135-8daf-3d3a4c8c65cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:15.273002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85154e58-2860-4135-8daf-3d3a4c8c65cd None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.273284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85154e58-2860-4135-8daf-3d3a4c8c65cd None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.273557 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85154e58-2860-4135-8daf-3d3a4c8c65cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.289917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85154e58-2860-4135-8daf-3d3a4c8c65cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-85154e58-2860-4135-8daf-3d3a4c8c65cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:15.297643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:15.298521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:15.300109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 270/544] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:15.308148 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67511-cd05-4147-b06e-b82c535382e2 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:15.443748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a67511-cd05-4147-b06e-b82c535382e2 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.496548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33cf2a-e61a-49a2-8b3a-bfd7a09e6f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:15.497234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33cf2a-e61a-49a2-8b3a-bfd7a09e6f34 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.497523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33cf2a-e61a-49a2-8b3a-bfd7a09e6f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.497805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33cf2a-e61a-49a2-8b3a-bfd7a09e6f34 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.498561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33cf2a-e61a-49a2-8b3a-bfd7a09e6f34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:15.498873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33cf2a-e61a-49a2-8b3a-bfd7a09e6f34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:15.500303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33cf2a-e61a-49a2-8b3a-bfd7a09e6f34 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:15.503997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154780-af1f-4ce0-a3c9-926e349b13f1 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.503997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154780-af1f-4ce0-a3c9-926e349b13f1 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.503997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154780-af1f-4ce0-a3c9-926e349b13f1 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.507454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 271/545] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:15.508012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:15.512410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 275/546] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:15.518349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154780-af1f-4ce0-a3c9-926e349b13f1 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:15.521421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d19a6-550f-445c-8172-9b576b3acac4 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.521920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d19a6-550f-445c-8172-9b576b3acac4 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.522392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71d19a6-550f-445c-8172-9b576b3acac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.539904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b71d19a6-550f-445c-8172-9b576b3acac4 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:15.541436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b71d19a6-550f-445c-8172-9b576b3acac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:15.618835 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 276/547] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:15.637592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d19a6-550f-445c-8172-9b576b3acac4 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:15.707301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154780-af1f-4ce0-a3c9-926e349b13f1 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.772155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691a8f-36cb-4b5e-9080-df544970fc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:15.772963 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691a8f-36cb-4b5e-9080-df544970fc2c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.773248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691a8f-36cb-4b5e-9080-df544970fc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.773528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68691a8f-36cb-4b5e-9080-df544970fc2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.797346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68691a8f-36cb-4b5e-9080-df544970fc2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:15.799545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68691a8f-36cb-4b5e-9080-df544970fc2c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:15.813901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71d19a6-550f-445c-8172-9b576b3acac4 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-68691a8f-36cb-4b5e-9080-df544970fc2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:15.836198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:15.837088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:15.838616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:15.838616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:15.838616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:15.838616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:15.838616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 272/548] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:15.843442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691a8f-36cb-4b5e-9080-df544970fc2c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:15.878397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:15.891223 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:15.907220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657a79-b0dd-4d44-bea6-639f0803826c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:15.908031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657a79-b0dd-4d44-bea6-639f0803826c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:15.908365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657a79-b0dd-4d44-bea6-639f0803826c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:15.908646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657a79-b0dd-4d44-bea6-639f0803826c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:15.959694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86657a79-b0dd-4d44-bea6-639f0803826c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:15.965654 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68691a8f-36cb-4b5e-9080-df544970fc2c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-86657a79-b0dd-4d44-bea6-639f0803826c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:15.976184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:15.977180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:15.978840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 277/549] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:15.986384 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657a79-b0dd-4d44-bea6-639f0803826c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.051711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3afbad-3c0a-4d63-ad34-5dcff21dd06d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.052379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3afbad-3c0a-4d63-ad34-5dcff21dd06d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.052658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3afbad-3c0a-4d63-ad34-5dcff21dd06d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.052934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3afbad-3c0a-4d63-ad34-5dcff21dd06d None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.053658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3afbad-3c0a-4d63-ad34-5dcff21dd06d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:16.053961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3afbad-3c0a-4d63-ad34-5dcff21dd06d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:16.055374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3afbad-3c0a-4d63-ad34-5dcff21dd06d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:16.075839 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 273/550] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:16.081091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3afbad-3c0a-4d63-ad34-5dcff21dd06d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.276677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657a79-b0dd-4d44-bea6-639f0803826c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:16.279346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:16.290723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3afbad-3c0a-4d63-ad34-5dcff21dd06d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:16.329059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58112845-44f9-40f7-9972-c66d9cd092d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.331296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58112845-44f9-40f7-9972-c66d9cd092d7 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.332667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58112845-44f9-40f7-9972-c66d9cd092d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.334852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58112845-44f9-40f7-9972-c66d9cd092d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.335968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58112845-44f9-40f7-9972-c66d9cd092d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:16.336471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58112845-44f9-40f7-9972-c66d9cd092d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:16.339325 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2f334d-78d1-49b8-8f69-bb209981d548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.340042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58112845-44f9-40f7-9972-c66d9cd092d7 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:16.340216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f334d-78d1-49b8-8f69-bb209981d548 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.340604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f334d-78d1-49b8-8f69-bb209981d548 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.340943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2f334d-78d1-49b8-8f69-bb209981d548 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.350077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f334d-78d1-49b8-8f69-bb209981d548 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:16.351720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2f334d-78d1-49b8-8f69-bb209981d548 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:16.360454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 278/551] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:16.362009 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7da38-d003-4d0e-b31b-d1c122590632 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.362794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7da38-d003-4d0e-b31b-d1c122590632 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.363991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b7da38-d003-4d0e-b31b-d1c122590632 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.370350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 279/552] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:16 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:16.371799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7da38-d003-4d0e-b31b-d1c122590632 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-ea2f334d-78d1-49b8-8f69-bb209981d548 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:16.373134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:16.373996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:16.375041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:16.375041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:16.375041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:16.375041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:16.375041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:16.375041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:16.375041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:16.375041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:16.375041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:16.375041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:16.382474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 274/553] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:16.384271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb56f1-b152-4492-95e1-5bf9063ce4e3 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.386066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb56f1-b152-4492-95e1-5bf9063ce4e3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.386356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffb56f1-b152-4492-95e1-5bf9063ce4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.415255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-3ffb56f1-b152-4492-95e1-5bf9063ce4e3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:16.416630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3ffb56f1-b152-4492-95e1-5bf9063ce4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:16.452589 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:16.529848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 275/554] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:16.529848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb56f1-b152-4492-95e1-5bf9063ce4e3 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.567691 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b7da38-d003-4d0e-b31b-d1c122590632 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:16.633943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987490-ebf2-4a1b-a46e-44c9a7306801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.634741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987490-ebf2-4a1b-a46e-44c9a7306801 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.635039 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987490-ebf2-4a1b-a46e-44c9a7306801 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.635312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45987490-ebf2-4a1b-a46e-44c9a7306801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.654393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45987490-ebf2-4a1b-a46e-44c9a7306801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:16.655901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45987490-ebf2-4a1b-a46e-44c9a7306801 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:16.678799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-45987490-ebf2-4a1b-a46e-44c9a7306801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:16.685211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:16.686079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:16.687057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:16.687057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:16.687057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:16.687057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:16.689951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 280/555] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:16.691775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987490-ebf2-4a1b-a46e-44c9a7306801 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.702119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffb56f1-b152-4492-95e1-5bf9063ce4e3 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:16.744554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0429-19be-4758-9b07-843533869611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.745594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0429-19be-4758-9b07-843533869611 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.745880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0429-19be-4758-9b07-843533869611 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.746151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba0429-19be-4758-9b07-843533869611 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.746995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba0429-19be-4758-9b07-843533869611 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:16.747304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba0429-19be-4758-9b07-843533869611 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:16.749105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba0429-19be-4758-9b07-843533869611 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:16.773321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 276/556] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 21 04:05:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:16.773993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0429-19be-4758-9b07-843533869611 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.833600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45987490-ebf2-4a1b-a46e-44c9a7306801 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:16.836736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:16.871667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671178f-ba6b-465e-b33f-709ac26cfed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.872780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671178f-ba6b-465e-b33f-709ac26cfed5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.873078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671178f-ba6b-465e-b33f-709ac26cfed5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.873340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a671178f-ba6b-465e-b33f-709ac26cfed5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.887021 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a671178f-ba6b-465e-b33f-709ac26cfed5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:16.898002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba0429-19be-4758-9b07-843533869611 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-a671178f-ba6b-465e-b33f-709ac26cfed5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:16.898242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:16.899155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:16.900508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:16.904509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 281/557] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:16.906365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671178f-ba6b-465e-b33f-709ac26cfed5 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:16.943521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5c53e-965a-45e2-941e-96ee3a96b32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:16.944146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5c53e-965a-45e2-941e-96ee3a96b32b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:16.944427 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5c53e-965a-45e2-941e-96ee3a96b32b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:16.944701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd5c53e-965a-45e2-941e-96ee3a96b32b None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:16.945425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5c53e-965a-45e2-941e-96ee3a96b32b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:16.945732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5c53e-965a-45e2-941e-96ee3a96b32b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:16.947333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd5c53e-965a-45e2-941e-96ee3a96b32b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:16.955604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:16.960381 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 277/558] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:16.961257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5c53e-965a-45e2-941e-96ee3a96b32b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.029312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a671178f-ba6b-465e-b33f-709ac26cfed5 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.067781 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd5c53e-965a-45e2-941e-96ee3a96b32b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.071094 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f9f94-d46c-4c61-8cec-9453a2b47aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.071984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f9f94-d46c-4c61-8cec-9453a2b47aca None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.072495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f9f94-d46c-4c61-8cec-9453a2b47aca None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.072988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f9f94-d46c-4c61-8cec-9453a2b47aca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.103419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7b4bc-437a-4aee-a1dd-28b96bf133ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.103934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7b4bc-437a-4aee-a1dd-28b96bf133ee None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.104224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7b4bc-437a-4aee-a1dd-28b96bf133ee None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.104487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7b4bc-437a-4aee-a1dd-28b96bf133ee None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.105287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7b4bc-437a-4aee-a1dd-28b96bf133ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:17.105521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7b4bc-437a-4aee-a1dd-28b96bf133ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.106887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7b4bc-437a-4aee-a1dd-28b96bf133ee None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.111234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.120204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 278/559] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:17.121111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7b4bc-437a-4aee-a1dd-28b96bf133ee None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.156260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f9f94-d46c-4c61-8cec-9453a2b47aca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.158248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f9f94-d46c-4c61-8cec-9453a2b47aca None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.187324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.228528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7b4bc-437a-4aee-a1dd-28b96bf133ee None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.262919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0168-0385-4216-b9c7-78d7a2bcbf45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.263741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0168-0385-4216-b9c7-78d7a2bcbf45 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.264022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0168-0385-4216-b9c7-78d7a2bcbf45 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.264290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c0168-0385-4216-b9c7-78d7a2bcbf45 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.272753 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0168-0385-4216-b9c7-78d7a2bcbf45 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.274219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c0168-0385-4216-b9c7-78d7a2bcbf45 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.284482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 282/560] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:17.286167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f9f94-d46c-4c61-8cec-9453a2b47aca None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f18c0168-0385-4216-b9c7-78d7a2bcbf45 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:17.293463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:17.294759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:17.295728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 279/561] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:17.296319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0168-0385-4216-b9c7-78d7a2bcbf45 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.360093 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.400415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c0168-0385-4216-b9c7-78d7a2bcbf45 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.401979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f9f94-d46c-4c61-8cec-9453a2b47aca None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.422930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.435776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcec7b7-ce5b-480e-ab96-fddba20da0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.436563 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcec7b7-ce5b-480e-ab96-fddba20da0cf None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.436846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcec7b7-ce5b-480e-ab96-fddba20da0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.437120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcec7b7-ce5b-480e-ab96-fddba20da0cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.437482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84769ea-603a-4b9b-8d80-dea28f2c261e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.438266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84769ea-603a-4b9b-8d80-dea28f2c261e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.438548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84769ea-603a-4b9b-8d80-dea28f2c261e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.438834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84769ea-603a-4b9b-8d80-dea28f2c261e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.448068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcec7b7-ce5b-480e-ab96-fddba20da0cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.448666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84769ea-603a-4b9b-8d80-dea28f2c261e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.449545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcec7b7-ce5b-480e-ab96-fddba20da0cf None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.450109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84769ea-603a-4b9b-8d80-dea28f2c261e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-6bcec7b7-ce5b-480e-ab96-fddba20da0cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:17.466762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:17.467857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:17.468792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:17.468792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:17.468792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:17.468792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-e84769ea-603a-4b9b-8d80-dea28f2c261e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:17.469018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:17.469805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:17.470706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:17.470706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:17.470706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:17.470706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:17.470938 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 280/562] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:17.471033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 283/563] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:17.471103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcec7b7-ce5b-480e-ab96-fddba20da0cf None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.471172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acd6fc-f762-4712-a622-ff6bff8af577 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.471172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acd6fc-f762-4712-a622-ff6bff8af577 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.471172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66acd6fc-f762-4712-a622-ff6bff8af577 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.472163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 284/564] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:17.473140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18c87-3a61-45ef-822c-1399b7f3db4d None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.473453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18c87-3a61-45ef-822c-1399b7f3db4d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.473683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f18c87-3a61-45ef-822c-1399b7f3db4d None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.475311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 285/565] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:17.475877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18c87-3a61-45ef-822c-1399b7f3db4d None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.574946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcec7b7-ce5b-480e-ab96-fddba20da0cf None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.576029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f18c87-3a61-45ef-822c-1399b7f3db4d None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.592661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.608201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcaf54-2b81-43be-82d1-1910a3b996ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.608860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcaf54-2b81-43be-82d1-1910a3b996ec None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.609142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcaf54-2b81-43be-82d1-1910a3b996ec None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.609417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcaf54-2b81-43be-82d1-1910a3b996ec None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.610300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcaf54-2b81-43be-82d1-1910a3b996ec None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:17.610552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcaf54-2b81-43be-82d1-1910a3b996ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.611137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5c8c9-ae8f-4463-9285-a7befe90d2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.611788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5c8c9-ae8f-4463-9285-a7befe90d2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.612027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcaf54-2b81-43be-82d1-1910a3b996ec None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.612118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5c8c9-ae8f-4463-9285-a7befe90d2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.612331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5c8c9-ae8f-4463-9285-a7befe90d2c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.613628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5c8c9-ae8f-4463-9285-a7befe90d2c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:17.613936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5c8c9-ae8f-4463-9285-a7befe90d2c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.615518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5c8c9-ae8f-4463-9285-a7befe90d2c8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.627506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 286/566] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:17.628323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5c8c9-ae8f-4463-9285-a7befe90d2c8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.634587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 281/567] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:17.636598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06385-47f1-4203-85a7-a9055fb86800 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.637044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06385-47f1-4203-85a7-a9055fb86800 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.637471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a06385-47f1-4203-85a7-a9055fb86800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.654571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-95a06385-47f1-4203-85a7-a9055fb86800 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:17.655807 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-95a06385-47f1-4203-85a7-a9055fb86800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:17.681966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.723416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 282/568] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:17.724755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98fce0-88f2-454d-88ed-065cad1884a0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.725054 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98fce0-88f2-454d-88ed-065cad1884a0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.725328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98fce0-88f2-454d-88ed-065cad1884a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.728814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5c8c9-ae8f-4463-9285-a7befe90d2c8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.751418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-bc98fce0-88f2-454d-88ed-065cad1884a0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:17.752611 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bc98fce0-88f2-454d-88ed-065cad1884a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:17.762698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78938ef7-c95c-4e90-9ca0-9508f478b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.763394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78938ef7-c95c-4e90-9ca0-9508f478b963 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.763676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78938ef7-c95c-4e90-9ca0-9508f478b963 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.763953 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78938ef7-c95c-4e90-9ca0-9508f478b963 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.764680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78938ef7-c95c-4e90-9ca0-9508f478b963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:17.764987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78938ef7-c95c-4e90-9ca0-9508f478b963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.766409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78938ef7-c95c-4e90-9ca0-9508f478b963 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.778175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 287/569] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:17.778983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78938ef7-c95c-4e90-9ca0-9508f478b963 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.813065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.821749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 283/570] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:17.822595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98fce0-88f2-454d-88ed-065cad1884a0 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.880981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78938ef7-c95c-4e90-9ca0-9508f478b963 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.913320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:17.914796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46004c8-cf39-4f14-be0a-9578cb6d87a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.916007 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46004c8-cf39-4f14-be0a-9578cb6d87a6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.916550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46004c8-cf39-4f14-be0a-9578cb6d87a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.917039 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46004c8-cf39-4f14-be0a-9578cb6d87a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.922338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98fce0-88f2-454d-88ed-065cad1884a0 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:17.924675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46004c8-cf39-4f14-be0a-9578cb6d87a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.927275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46004c8-cf39-4f14-be0a-9578cb6d87a6 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f46004c8-cf39-4f14-be0a-9578cb6d87a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:17.940928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:17.942449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:17.943383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:17.943383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:17.943383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:17.943383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:17.943383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:17.943383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:17.943383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:17.943383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:17.943383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 288/571] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:17.944089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46004c8-cf39-4f14-be0a-9578cb6d87a6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:17.958606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e3e28-14db-4744-9b3f-ac033a386a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:17.959432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3e28-14db-4744-9b3f-ac033a386a7f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:17.959715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3e28-14db-4744-9b3f-ac033a386a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:17.959991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e3e28-14db-4744-9b3f-ac033a386a7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:17.970278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e3e28-14db-4744-9b3f-ac033a386a7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:17.971906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9e3e28-14db-4744-9b3f-ac033a386a7f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0a9e3e28-14db-4744-9b3f-ac033a386a7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:17.989765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:17.990693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:17.991613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:17.991613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:17.991613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:17.991613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:17.991613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 284/572] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:17.992028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e3e28-14db-4744-9b3f-ac033a386a7f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.045361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.052912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46004c8-cf39-4f14-be0a-9578cb6d87a6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.086360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9311b-1627-4973-8f34-8804d8488f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.087183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9311b-1627-4973-8f34-8804d8488f48 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.087471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9311b-1627-4973-8f34-8804d8488f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.087752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9311b-1627-4973-8f34-8804d8488f48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.093197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9e3e28-14db-4744-9b3f-ac033a386a7f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.099138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9311b-1627-4973-8f34-8804d8488f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-12d9311b-1627-4973-8f34-8804d8488f48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:18.106914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:18.108067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:18.109106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 289/573] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:18.109925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9311b-1627-4973-8f34-8804d8488f48 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.129965 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211404e-97f5-4556-ae2a-736798b1332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.130750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211404e-97f5-4556-ae2a-736798b1332b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.131112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211404e-97f5-4556-ae2a-736798b1332b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.131335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211404e-97f5-4556-ae2a-736798b1332b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.138252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211404e-97f5-4556-ae2a-736798b1332b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.139739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211404e-97f5-4556-ae2a-736798b1332b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-3211404e-97f5-4556-ae2a-736798b1332b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:18.155132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:18.156256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 285/574] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:18.157590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211404e-97f5-4556-ae2a-736798b1332b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.161904 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.218199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9311b-1627-4973-8f34-8804d8488f48 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.252719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd88c7-2e91-4abc-b91a-527e089f8566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.253998 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd88c7-2e91-4abc-b91a-527e089f8566 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.254554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd88c7-2e91-4abc-b91a-527e089f8566 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.254666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd88c7-2e91-4abc-b91a-527e089f8566 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.261150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211404e-97f5-4556-ae2a-736798b1332b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.264354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd88c7-2e91-4abc-b91a-527e089f8566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-ecfd88c7-2e91-4abc-b91a-527e089f8566 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:18.272709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:18.273656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:18.274488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 290/575] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:18.275219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd88c7-2e91-4abc-b91a-527e089f8566 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.292423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.299619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce875a-e7b8-41fb-8186-88b2aa8a15f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.300397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce875a-e7b8-41fb-8186-88b2aa8a15f0 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.300733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce875a-e7b8-41fb-8186-88b2aa8a15f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.301080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce875a-e7b8-41fb-8186-88b2aa8a15f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.301866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce875a-e7b8-41fb-8186-88b2aa8a15f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:18.302181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce875a-e7b8-41fb-8186-88b2aa8a15f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.303666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce875a-e7b8-41fb-8186-88b2aa8a15f0 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.314982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 286/576] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:18.315762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce875a-e7b8-41fb-8186-88b2aa8a15f0 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.377008 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd88c7-2e91-4abc-b91a-527e089f8566 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.377596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.410652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1282c-6d19-489b-8b43-89a6ddfdfdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.411259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1282c-6d19-489b-8b43-89a6ddfdfdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.411541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1282c-6d19-489b-8b43-89a6ddfdfdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.411812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1282c-6d19-489b-8b43-89a6ddfdfdb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.412523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1282c-6d19-489b-8b43-89a6ddfdfdb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:18.412823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1282c-6d19-489b-8b43-89a6ddfdfdb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.414202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f1282c-6d19-489b-8b43-89a6ddfdfdb8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.417149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce875a-e7b8-41fb-8186-88b2aa8a15f0 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.426072 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 291/577] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:18.426852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1282c-6d19-489b-8b43-89a6ddfdfdb8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.452426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac7ec3-1172-4f1f-b4b6-1d53aacb27d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.453090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7ec3-1172-4f1f-b4b6-1d53aacb27d2 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.453374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7ec3-1172-4f1f-b4b6-1d53aacb27d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.453652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac7ec3-1172-4f1f-b4b6-1d53aacb27d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.454392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac7ec3-1172-4f1f-b4b6-1d53aacb27d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:18.454700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac7ec3-1172-4f1f-b4b6-1d53aacb27d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.456113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac7ec3-1172-4f1f-b4b6-1d53aacb27d2 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.464181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 287/578] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:18.464954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac7ec3-1172-4f1f-b4b6-1d53aacb27d2 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.506034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.528099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f1282c-6d19-489b-8b43-89a6ddfdfdb8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.561334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f889-d928-4745-b011-23d1ed71c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.561992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f889-d928-4745-b011-23d1ed71c568 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.562272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f889-d928-4745-b011-23d1ed71c568 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.562545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae34f889-d928-4745-b011-23d1ed71c568 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.563411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f889-d928-4745-b011-23d1ed71c568 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:18.563714 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f889-d928-4745-b011-23d1ed71c568 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.565138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae34f889-d928-4745-b011-23d1ed71c568 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.565457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac7ec3-1172-4f1f-b4b6-1d53aacb27d2 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.582162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 292/579] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:18.582990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f889-d928-4745-b011-23d1ed71c568 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.596018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.604843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c01be-adb0-4c46-84c1-126629523d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.605507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c01be-adb0-4c46-84c1-126629523d96 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.605794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c01be-adb0-4c46-84c1-126629523d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.606074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c01be-adb0-4c46-84c1-126629523d96 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.606818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c01be-adb0-4c46-84c1-126629523d96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:18.607165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c01be-adb0-4c46-84c1-126629523d96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.608550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c01be-adb0-4c46-84c1-126629523d96 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.617036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 288/580] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:18.617814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c01be-adb0-4c46-84c1-126629523d96 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.682256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae34f889-d928-4745-b011-23d1ed71c568 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.715577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52d7be-0aa8-4ad8-8dfd-55515706ac5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.716226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52d7be-0aa8-4ad8-8dfd-55515706ac5b None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.716511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52d7be-0aa8-4ad8-8dfd-55515706ac5b None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.716788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52d7be-0aa8-4ad8-8dfd-55515706ac5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.717530 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c01be-adb0-4c46-84c1-126629523d96 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.717628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52d7be-0aa8-4ad8-8dfd-55515706ac5b None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=4bfb2a63f46a4a419da65805253ef7ac) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:18.717915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52d7be-0aa8-4ad8-8dfd-55515706ac5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.719388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e52d7be-0aa8-4ad8-8dfd-55515706ac5b None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.721183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.730567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 293/581] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/role_assignments?user.id=4bfb2a63f46a4a419da65805253ef7ac&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:18.731540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52d7be-0aa8-4ad8-8dfd-55515706ac5b None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.758646 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de1aa0-303b-443b-ac99-406fd51c81ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.759790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de1aa0-303b-443b-ac99-406fd51c81ab None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.760080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de1aa0-303b-443b-ac99-406fd51c81ab None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.760366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de1aa0-303b-443b-ac99-406fd51c81ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.770934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de1aa0-303b-443b-ac99-406fd51c81ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.773631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de1aa0-303b-443b-ac99-406fd51c81ab None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-36de1aa0-303b-443b-ac99-406fd51c81ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:18.793669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:18.794627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:18.796353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:18.796353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:18.796353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:18.796353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:18.796353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:18.796353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:18.796353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:18.796353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:18.796353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 289/582] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:18.799074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de1aa0-303b-443b-ac99-406fd51c81ab None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.850832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52d7be-0aa8-4ad8-8dfd-55515706ac5b None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.856764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.892139 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb9702-9cf4-47b7-9636-8fd107ef7fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.893068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9702-9cf4-47b7-9636-8fd107ef7fde None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.893420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9702-9cf4-47b7-9636-8fd107ef7fde None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.893767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9702-9cf4-47b7-9636-8fd107ef7fde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.905070 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb9702-9cf4-47b7-9636-8fd107ef7fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.906537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb9702-9cf4-47b7-9636-8fd107ef7fde None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.920091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de1aa0-303b-443b-ac99-406fd51c81ab None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-0ccb9702-9cf4-47b7-9636-8fd107ef7fde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:18.924788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:18.926235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:18.927268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:18.927268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:18.927268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:18.927268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:18.927268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 294/583] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:18.928055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb9702-9cf4-47b7-9636-8fd107ef7fde None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:18.959979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf661e4-756f-4a40-9e17-fc38f234fb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:18.960684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf661e4-756f-4a40-9e17-fc38f234fb40 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:18.960965 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf661e4-756f-4a40-9e17-fc38f234fb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:18.961236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf661e4-756f-4a40-9e17-fc38f234fb40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:18.971483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf661e4-756f-4a40-9e17-fc38f234fb40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:18.973014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf661e4-756f-4a40-9e17-fc38f234fb40 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:18.981858 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-9bf661e4-756f-4a40-9e17-fc38f234fb40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:18.991962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:18.992900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:18.993785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:18.993785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:18.993785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:18.993785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:18.993785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 290/584] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:18.994068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf661e4-756f-4a40-9e17-fc38f234fb40 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.042357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb9702-9cf4-47b7-9636-8fd107ef7fde None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.080842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3148823-1d4f-4baa-bb9c-4d4ab48b3a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.082690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3148823-1d4f-4baa-bb9c-4d4ab48b3a03 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.083182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3148823-1d4f-4baa-bb9c-4d4ab48b3a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.083633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3148823-1d4f-4baa-bb9c-4d4ab48b3a03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.095042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.096520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3148823-1d4f-4baa-bb9c-4d4ab48b3a03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.099107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf661e4-756f-4a40-9e17-fc38f234fb40 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.100017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3148823-1d4f-4baa-bb9c-4d4ab48b3a03 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-e3148823-1d4f-4baa-bb9c-4d4ab48b3a03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:19.119194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:19.120276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:19.121351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:19.121351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:19.121351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:19.121351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:19.127613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 295/585] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:19.128633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3148823-1d4f-4baa-bb9c-4d4ab48b3a03 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.136980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf2b39-96e6-40c9-8a45-643767879e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.137640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf2b39-96e6-40c9-8a45-643767879e1e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.137933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf2b39-96e6-40c9-8a45-643767879e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.138203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf2b39-96e6-40c9-8a45-643767879e1e None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.139018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf2b39-96e6-40c9-8a45-643767879e1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:19.139334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf2b39-96e6-40c9-8a45-643767879e1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.140784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf2b39-96e6-40c9-8a45-643767879e1e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.153418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 291/586] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:19.154261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf2b39-96e6-40c9-8a45-643767879e1e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.239687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3148823-1d4f-4baa-bb9c-4d4ab48b3a03 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.241506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.275258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf2b39-96e6-40c9-8a45-643767879e1e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.277182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e96f7-e15b-4ce0-b2b4-96b40b0faa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.277847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e96f7-e15b-4ce0-b2b4-96b40b0faa81 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.278127 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e96f7-e15b-4ce0-b2b4-96b40b0faa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.278398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75e96f7-e15b-4ce0-b2b4-96b40b0faa81 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.279146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e96f7-e15b-4ce0-b2b4-96b40b0faa81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:19.279450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e96f7-e15b-4ce0-b2b4-96b40b0faa81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.280838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75e96f7-e15b-4ce0-b2b4-96b40b0faa81 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.293261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 296/587] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:19.294080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e96f7-e15b-4ce0-b2b4-96b40b0faa81 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.317754 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27a650-7afb-45de-8161-990ec11792e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.319406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a650-7afb-45de-8161-990ec11792e3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.319738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a650-7afb-45de-8161-990ec11792e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.320012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a650-7afb-45de-8161-990ec11792e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.320735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27a650-7afb-45de-8161-990ec11792e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:19.321042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27a650-7afb-45de-8161-990ec11792e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.322719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec27a650-7afb-45de-8161-990ec11792e3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.341673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 292/588] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:19.341673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27a650-7afb-45de-8161-990ec11792e3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.366108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.403096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75e96f7-e15b-4ce0-b2b4-96b40b0faa81 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.437805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9581535-2d09-49d8-80ec-571cf37e86a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.438465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581535-2d09-49d8-80ec-571cf37e86a3 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.438746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581535-2d09-49d8-80ec-571cf37e86a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.439046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581535-2d09-49d8-80ec-571cf37e86a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.439767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9581535-2d09-49d8-80ec-571cf37e86a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:19.440075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9581535-2d09-49d8-80ec-571cf37e86a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.442231 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9581535-2d09-49d8-80ec-571cf37e86a3 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.453195 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 297/589] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:19.453710 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27a650-7afb-45de-8161-990ec11792e3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.453970 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9581535-2d09-49d8-80ec-571cf37e86a3 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.482552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.495695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05049ce2-d86f-4e3a-b61b-56ce5974808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.496508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049ce2-d86f-4e3a-b61b-56ce5974808c None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.496793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049ce2-d86f-4e3a-b61b-56ce5974808c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.497062 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05049ce2-d86f-4e3a-b61b-56ce5974808c None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/5a82fed4ff8845919b1da05f7e8d1d72/roles/a1c2e9dff7da4c458034685fb77fed4b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.512616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05049ce2-d86f-4e3a-b61b-56ce5974808c None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=5a82fed4ff8845919b1da05f7e8d1d72, role_id=a1c2e9dff7da4c458034685fb77fed4b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.514080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05049ce2-d86f-4e3a-b61b-56ce5974808c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.527973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 293/590] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:19 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/5a82fed4ff8845919b1da05f7e8d1d72/roles/a1c2e9dff7da4c458034685fb77fed4b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:19.529063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05049ce2-d86f-4e3a-b61b-56ce5974808c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.603738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9581535-2d09-49d8-80ec-571cf37e86a3 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.620092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.649462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b873f6-3e55-42fc-88f0-0b67a53a5b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.650731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b873f6-3e55-42fc-88f0-0b67a53a5b78 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.651285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b873f6-3e55-42fc-88f0-0b67a53a5b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.651866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b873f6-3e55-42fc-88f0-0b67a53a5b78 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.662224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b873f6-3e55-42fc-88f0-0b67a53a5b78 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.663448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05049ce2-d86f-4e3a-b61b-56ce5974808c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.664410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b873f6-3e55-42fc-88f0-0b67a53a5b78 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-80b873f6-3e55-42fc-88f0-0b67a53a5b78 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:19.682749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:19.683829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 298/591] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:19.685573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b873f6-3e55-42fc-88f0-0b67a53a5b78 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.713339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665417-10a4-4960-8037-a87934850d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.714602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665417-10a4-4960-8037-a87934850d75 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.715141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665417-10a4-4960-8037-a87934850d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.715620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36665417-10a4-4960-8037-a87934850d75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.724449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36665417-10a4-4960-8037-a87934850d75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.725930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36665417-10a4-4960-8037-a87934850d75 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-36665417-10a4-4960-8037-a87934850d75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:19.746577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:19.747518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:19.748398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:19.748398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:19.748398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:19.748398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:19.748398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:19.748398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:19.748398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:19.748398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:19.748398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 294/592] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:19.748887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665417-10a4-4960-8037-a87934850d75 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.786263 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.806285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b873f6-3e55-42fc-88f0-0b67a53a5b78 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.850141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e2329-85e0-4183-8748-911d19b25c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.851355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e2329-85e0-4183-8748-911d19b25c11 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.851898 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e2329-85e0-4183-8748-911d19b25c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.852190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e2329-85e0-4183-8748-911d19b25c11 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.862054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e2329-85e0-4183-8748-911d19b25c11 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.864337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e2329-85e0-4183-8748-911d19b25c11 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.869564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36665417-10a4-4960-8037-a87934850d75 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f85e2329-85e0-4183-8748-911d19b25c11 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:19.880541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:19.881508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:19.882421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 299/593] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:19.883031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e2329-85e0-4183-8748-911d19b25c11 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:19.907380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:19.912062 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5313b-a385-40b6-9ca1-647c23ab1ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:19.913047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5313b-a385-40b6-9ca1-647c23ab1ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:19.913392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5313b-a385-40b6-9ca1-647c23ab1ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:19.913888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5313b-a385-40b6-9ca1-647c23ab1ad8 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:19.914851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5313b-a385-40b6-9ca1-647c23ab1ad8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:19.915338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5313b-a385-40b6-9ca1-647c23ab1ad8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:19.918185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5313b-a385-40b6-9ca1-647c23ab1ad8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:19.944255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 295/594] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:19.945183 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5313b-a385-40b6-9ca1-647c23ab1ad8 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.023999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e2329-85e0-4183-8748-911d19b25c11 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.062018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5313b-a385-40b6-9ca1-647c23ab1ad8 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.065661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9514142-7089-4510-a0ad-089f7c066146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.066678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9514142-7089-4510-a0ad-089f7c066146 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.067188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9514142-7089-4510-a0ad-089f7c066146 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.067638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9514142-7089-4510-a0ad-089f7c066146 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.068615 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9514142-7089-4510-a0ad-089f7c066146 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:20.069100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9514142-7089-4510-a0ad-089f7c066146 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.070815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9514142-7089-4510-a0ad-089f7c066146 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.085975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 300/595] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:20.087130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9514142-7089-4510-a0ad-089f7c066146 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.101529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.102916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600c08e-4fb5-4fcb-ae1d-3f06b14b2aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.104023 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c08e-4fb5-4fcb-ae1d-3f06b14b2aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.104785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c08e-4fb5-4fcb-ae1d-3f06b14b2aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.104785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600c08e-4fb5-4fcb-ae1d-3f06b14b2aa6 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.106238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600c08e-4fb5-4fcb-ae1d-3f06b14b2aa6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:20.106910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600c08e-4fb5-4fcb-ae1d-3f06b14b2aa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.108745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600c08e-4fb5-4fcb-ae1d-3f06b14b2aa6 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.131337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 296/596] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jul 21 04:05:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:20.132212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600c08e-4fb5-4fcb-ae1d-3f06b14b2aa6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.203353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.203997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9514142-7089-4510-a0ad-089f7c066146 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.245356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d5d80-5be4-4666-8f41-53e0739b1110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.246551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5d80-5be4-4666-8f41-53e0739b1110 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.247063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5d80-5be4-4666-8f41-53e0739b1110 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.247543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50d5d80-5be4-4666-8f41-53e0739b1110 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.258116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d5d80-5be4-4666-8f41-53e0739b1110 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.259947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50d5d80-5be4-4666-8f41-53e0739b1110 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.264220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600c08e-4fb5-4fcb-ae1d-3f06b14b2aa6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-a50d5d80-5be4-4666-8f41-53e0739b1110 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:20.278929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:20.279850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:20.280739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:20.280739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:20.280739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:20.280739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:20.288031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 301/597] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:20.289237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d5d80-5be4-4666-8f41-53e0739b1110 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.305294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86349774-ed39-4ba9-adc0-ee16eaa8904d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.306180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86349774-ed39-4ba9-adc0-ee16eaa8904d None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.306470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86349774-ed39-4ba9-adc0-ee16eaa8904d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.306752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86349774-ed39-4ba9-adc0-ee16eaa8904d None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/92407a5a276247e79d2abe41fee54c33/roles/a1c2e9dff7da4c458034685fb77fed4b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.326282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86349774-ed39-4ba9-adc0-ee16eaa8904d None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=92407a5a276247e79d2abe41fee54c33, role_id=a1c2e9dff7da4c458034685fb77fed4b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.327924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86349774-ed39-4ba9-adc0-ee16eaa8904d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.354991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 297/598] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:20 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/92407a5a276247e79d2abe41fee54c33/roles/a1c2e9dff7da4c458034685fb77fed4b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:20.354991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86349774-ed39-4ba9-adc0-ee16eaa8904d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.363964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.481003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50d5d80-5be4-4666-8f41-53e0739b1110 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.534459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.542396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86349774-ed39-4ba9-adc0-ee16eaa8904d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.542983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960dd2-35af-4252-9f8e-59fdfdcbe249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.544037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960dd2-35af-4252-9f8e-59fdfdcbe249 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.544587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960dd2-35af-4252-9f8e-59fdfdcbe249 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.545063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57960dd2-35af-4252-9f8e-59fdfdcbe249 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.558940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960dd2-35af-4252-9f8e-59fdfdcbe249 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.560821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57960dd2-35af-4252-9f8e-59fdfdcbe249 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-57960dd2-35af-4252-9f8e-59fdfdcbe249 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:20.590473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:20.591718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:20.592606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:20.592606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:20.592606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:20.592606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:20.592606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 302/599] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:20.597727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d9b1-4cb3-4987-b370-b4235693821a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.597727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d9b1-4cb3-4987-b370-b4235693821a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.597727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d9b1-4cb3-4987-b370-b4235693821a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.597727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5247d9b1-4cb3-4987-b370-b4235693821a None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.598094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d9b1-4cb3-4987-b370-b4235693821a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:20.598094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d9b1-4cb3-4987-b370-b4235693821a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.598094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5247d9b1-4cb3-4987-b370-b4235693821a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.599412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960dd2-35af-4252-9f8e-59fdfdcbe249 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.611701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 298/600] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:20.617558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d9b1-4cb3-4987-b370-b4235693821a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.736335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57960dd2-35af-4252-9f8e-59fdfdcbe249 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.751326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.788726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5247d9b1-4cb3-4987-b370-b4235693821a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:20.809045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15394da3-658b-4a87-94e0-93a8c796f171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.809717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15394da3-658b-4a87-94e0-93a8c796f171 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.809996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15394da3-658b-4a87-94e0-93a8c796f171 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.810271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15394da3-658b-4a87-94e0-93a8c796f171 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.811014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15394da3-658b-4a87-94e0-93a8c796f171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:20.811321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15394da3-658b-4a87-94e0-93a8c796f171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.812718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15394da3-658b-4a87-94e0-93a8c796f171 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.835465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 303/601] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:20.844246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15394da3-658b-4a87-94e0-93a8c796f171 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.866195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8343d5-4155-4976-89bc-6c8987eb3b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:20.874973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8343d5-4155-4976-89bc-6c8987eb3b40 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:20.874973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8343d5-4155-4976-89bc-6c8987eb3b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:20.874973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8343d5-4155-4976-89bc-6c8987eb3b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:20.883920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8343d5-4155-4976-89bc-6c8987eb3b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:20.885389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8343d5-4155-4976-89bc-6c8987eb3b40 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-2c8343d5-4155-4976-89bc-6c8987eb3b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:20.913402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:20.914350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:20.915277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:20.915277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:20.915277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:20.915277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:20.915277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:20.915277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:20.915277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:20.915277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:20.919127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 299/602] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:20.920521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8343d5-4155-4976-89bc-6c8987eb3b40 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:20.955385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:20.982563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15394da3-658b-4a87-94e0-93a8c796f171 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.017695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eb830-f377-4fb2-be6f-28d0030d3177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.018486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eb830-f377-4fb2-be6f-28d0030d3177 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.018775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eb830-f377-4fb2-be6f-28d0030d3177 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.019619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eb830-f377-4fb2-be6f-28d0030d3177 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.026698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eb830-f377-4fb2-be6f-28d0030d3177 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.027876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8343d5-4155-4976-89bc-6c8987eb3b40 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.028220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154eb830-f377-4fb2-be6f-28d0030d3177 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-154eb830-f377-4fb2-be6f-28d0030d3177 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:21.043837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:21.044731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:21.045625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:21.045625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:21.045625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:21.045625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:21.045625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:21.045625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:21.045625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:21.045625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:21.045625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 304/603] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:21.046566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3ea75-e52b-493d-b98f-0ca3e7a193c3 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.047726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3ea75-e52b-493d-b98f-0ca3e7a193c3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.047726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af3ea75-e52b-493d-b98f-0ca3e7a193c3 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.048605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 305/604] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:21.053799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3ea75-e52b-493d-b98f-0ca3e7a193c3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.069281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ca346-4944-46fe-b01c-76afd55c9212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.070294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ca346-4944-46fe-b01c-76afd55c9212 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.070799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ca346-4944-46fe-b01c-76afd55c9212 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.071187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ca346-4944-46fe-b01c-76afd55c9212 None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.072051 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ca346-4944-46fe-b01c-76afd55c9212 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:21.072581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ca346-4944-46fe-b01c-76afd55c9212 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.074752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ca346-4944-46fe-b01c-76afd55c9212 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.085508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.094136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 300/605] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:21.094136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2fc7c-35c4-43a3-a7ef-fe97df9910ee None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.094136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2fc7c-35c4-43a3-a7ef-fe97df9910ee None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.094136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2fc7c-35c4-43a3-a7ef-fe97df9910ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.116406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-72e2fc7c-35c4-43a3-a7ef-fe97df9910ee None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:21.117976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-72e2fc7c-35c4-43a3-a7ef-fe97df9910ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:21.175344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af3ea75-e52b-493d-b98f-0ca3e7a193c3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.219038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 301/606] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:21.220834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2fc7c-35c4-43a3-a7ef-fe97df9910ee None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.233554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33090887-1eb9-42bf-823c-45c31e0f5eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.234532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33090887-1eb9-42bf-823c-45c31e0f5eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.235006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33090887-1eb9-42bf-823c-45c31e0f5eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.235481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33090887-1eb9-42bf-823c-45c31e0f5eb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.236981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33090887-1eb9-42bf-823c-45c31e0f5eb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:21.237563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33090887-1eb9-42bf-823c-45c31e0f5eb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.241250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33090887-1eb9-42bf-823c-45c31e0f5eb2 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.243329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.258615 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 306/607] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:21.260676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33090887-1eb9-42bf-823c-45c31e0f5eb2 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.355074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2fc7c-35c4-43a3-a7ef-fe97df9910ee None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.377677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.395118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33090887-1eb9-42bf-823c-45c31e0f5eb2 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.405394 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d996c-a23a-4a2c-ab64-7851b7a5f8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.406682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d996c-a23a-4a2c-ab64-7851b7a5f8e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.407000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d996c-a23a-4a2c-ab64-7851b7a5f8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.407288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d996c-a23a-4a2c-ab64-7851b7a5f8e3 None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/e210e10ee6b649399de11ac719a89718/roles/a1c2e9dff7da4c458034685fb77fed4b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.430015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d996c-a23a-4a2c-ab64-7851b7a5f8e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=e210e10ee6b649399de11ac719a89718, role_id=a1c2e9dff7da4c458034685fb77fed4b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.431819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4d996c-a23a-4a2c-ab64-7851b7a5f8e3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.432954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c1750-9224-4552-bf78-de80d27fc9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.434022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c1750-9224-4552-bf78-de80d27fc9c3 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.434513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c1750-9224-4552-bf78-de80d27fc9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.435037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c1750-9224-4552-bf78-de80d27fc9c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.454991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 302/608] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:21 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/e210e10ee6b649399de11ac719a89718/roles/a1c2e9dff7da4c458034685fb77fed4b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:21.454991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d996c-a23a-4a2c-ab64-7851b7a5f8e3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.457107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482c1750-9224-4552-bf78-de80d27fc9c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-482c1750-9224-4552-bf78-de80d27fc9c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:21.477336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:21.478342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:21.479214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:21.484365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 307/609] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:21.490048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c1750-9224-4552-bf78-de80d27fc9c3 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.577713 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.643241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d996c-a23a-4a2c-ab64-7851b7a5f8e3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.683324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853aecbb-6ada-4a5b-82d3-ca57c314a88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.684235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aecbb-6ada-4a5b-82d3-ca57c314a88b None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.684523 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aecbb-6ada-4a5b-82d3-ca57c314a88b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.684803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853aecbb-6ada-4a5b-82d3-ca57c314a88b None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/b3b2d5dee6d240558a71331e05035a30/roles/a1c2e9dff7da4c458034685fb77fed4b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.694602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c1750-9224-4552-bf78-de80d27fc9c3 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:21.703570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853aecbb-6ada-4a5b-82d3-ca57c314a88b None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=b3b2d5dee6d240558a71331e05035a30, role_id=a1c2e9dff7da4c458034685fb77fed4b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.705052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853aecbb-6ada-4a5b-82d3-ca57c314a88b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.723037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 303/610] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:21 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/b3b2d5dee6d240558a71331e05035a30/roles/a1c2e9dff7da4c458034685fb77fed4b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:21.743016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b1fc8-56a5-432b-b585-d3b44bd147e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:21.744213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b1fc8-56a5-432b-b585-d3b44bd147e3 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.744711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b1fc8-56a5-432b-b585-d3b44bd147e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.745279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b1fc8-56a5-432b-b585-d3b44bd147e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.746388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b1fc8-56a5-432b-b585-d3b44bd147e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:21.746978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b1fc8-56a5-432b-b585-d3b44bd147e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:21.748730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538b1fc8-56a5-432b-b585-d3b44bd147e3 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:21.750921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3237-01d7-4556-9016-c89960281300 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.751261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3237-01d7-4556-9016-c89960281300 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.751545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f3237-01d7-4556-9016-c89960281300 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.753239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 304/611] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:21.758883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d897c-e7cf-4c32-be1b-f009975e5da0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:21.759268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d897c-e7cf-4c32-be1b-f009975e5da0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:21.759507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d897c-e7cf-4c32-be1b-f009975e5da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:21.761217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 308/612] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:21.768104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b1fc8-56a5-432b-b585-d3b44bd147e3 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.784335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-3b6d897c-e7cf-4c32-be1b-f009975e5da0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:21.784335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3b6d897c-e7cf-4c32-be1b-f009975e5da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:21.791029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.865381 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 305/613] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:21.889787 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d897c-e7cf-4c32-be1b-f009975e5da0 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:21.928234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:21.996102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b1fc8-56a5-432b-b585-d3b44bd147e3 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.032652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d897c-e7cf-4c32-be1b-f009975e5da0 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.035576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb554c7-b29e-4b16-8627-0a1f2639b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.036559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb554c7-b29e-4b16-8627-0a1f2639b6be None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.036937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb554c7-b29e-4b16-8627-0a1f2639b6be None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.037306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb554c7-b29e-4b16-8627-0a1f2639b6be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.049258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb554c7-b29e-4b16-8627-0a1f2639b6be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.051773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb554c7-b29e-4b16-8627-0a1f2639b6be None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-feb554c7-b29e-4b16-8627-0a1f2639b6be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:22.069142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:22.070251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:22.071395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:22.071395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:22.071395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:22.071395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:22.073857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 309/614] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:22.074247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f215937-34e0-4c42-9763-f1291043519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.075080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f215937-34e0-4c42-9763-f1291043519f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.075366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f215937-34e0-4c42-9763-f1291043519f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.075696 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f215937-34e0-4c42-9763-f1291043519f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.080112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb554c7-b29e-4b16-8627-0a1f2639b6be None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.087819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f215937-34e0-4c42-9763-f1291043519f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0f215937-34e0-4c42-9763-f1291043519f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:22.098515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:22.099815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:22.100704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 306/615] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:22.105677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f215937-34e0-4c42-9763-f1291043519f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.192939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.243194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb554c7-b29e-4b16-8627-0a1f2639b6be None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.281623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f186b-5669-4083-b88f-65e87dc67799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.282571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f186b-5669-4083-b88f-65e87dc67799 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.283273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f186b-5669-4083-b88f-65e87dc67799 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.283699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298f186b-5669-4083-b88f-65e87dc67799 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.284582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f186b-5669-4083-b88f-65e87dc67799 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:22.286192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f186b-5669-4083-b88f-65e87dc67799 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.287888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298f186b-5669-4083-b88f-65e87dc67799 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.308465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 310/616] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:22.313868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f186b-5669-4083-b88f-65e87dc67799 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.354788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.362734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f215937-34e0-4c42-9763-f1291043519f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.411771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c793b64-a7f1-432b-b8ae-7c7e7e9f785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.412744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c793b64-a7f1-432b-b8ae-7c7e7e9f785a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.413177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c793b64-a7f1-432b-b8ae-7c7e7e9f785a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.413602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c793b64-a7f1-432b-b8ae-7c7e7e9f785a None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.414511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c793b64-a7f1-432b-b8ae-7c7e7e9f785a None admin] RBAC: Adding query filter params (name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:22.414982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c793b64-a7f1-432b-b8ae-7c7e7e9f785a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.420364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c793b64-a7f1-432b-b8ae-7c7e7e9f785a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.438911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 307/617] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:22.444384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c793b64-a7f1-432b-b8ae-7c7e7e9f785a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.514079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298f186b-5669-4083-b88f-65e87dc67799 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.540400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.558651 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42e1a7-04a2-4336-a85f-e5f57cb2e9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.559699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42e1a7-04a2-4336-a85f-e5f57cb2e9f6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.560131 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42e1a7-04a2-4336-a85f-e5f57cb2e9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.560553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42e1a7-04a2-4336-a85f-e5f57cb2e9f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.570859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42e1a7-04a2-4336-a85f-e5f57cb2e9f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.572541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42e1a7-04a2-4336-a85f-e5f57cb2e9f6 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-fa42e1a7-04a2-4336-a85f-e5f57cb2e9f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:22.591681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:22.592844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:22.594020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:22.594020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:22.594020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:22.594020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:22.594020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:22.594020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:22.594020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:22.594020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:22.594020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:22.594020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:22.602282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 311/618] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:22.603780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42e1a7-04a2-4336-a85f-e5f57cb2e9f6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.723023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42e1a7-04a2-4336-a85f-e5f57cb2e9f6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.755540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c793b64-a7f1-432b-b8ae-7c7e7e9f785a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.765576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e50b02-db52-408f-b101-b937f2753db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.766848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e50b02-db52-408f-b101-b937f2753db2 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.767571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e50b02-db52-408f-b101-b937f2753db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.768023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e50b02-db52-408f-b101-b937f2753db2 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.770809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e50b02-db52-408f-b101-b937f2753db2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:22.771303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e50b02-db52-408f-b101-b937f2753db2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.773432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e50b02-db52-408f-b101-b937f2753db2 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.791118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef883a9-9287-41e2-9d4a-252fb2056e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.791907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef883a9-9287-41e2-9d4a-252fb2056e9a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.792195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef883a9-9287-41e2-9d4a-252fb2056e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.792478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef883a9-9287-41e2-9d4a-252fb2056e9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.802363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 312/619] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:22.803980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54cd2-8107-408e-9e77-24f1eb6de10a None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.804969 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54cd2-8107-408e-9e77-24f1eb6de10a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.805530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54cd2-8107-408e-9e77-24f1eb6de10a None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.806543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef883a9-9287-41e2-9d4a-252fb2056e9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.807737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 313/620] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:22.811924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef883a9-9287-41e2-9d4a-252fb2056e9a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:22.812350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d54cd2-8107-408e-9e77-24f1eb6de10a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-2ef883a9-9287-41e2-9d4a-252fb2056e9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:22.834813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:22.835882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:22.836778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:22.836778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:22.836778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:22.836778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:22.839343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 308/621] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:22.840808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3dcd9-2e4f-4460-8ec1-7a0beb20297e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.841337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3dcd9-2e4f-4460-8ec1-7a0beb20297e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.841806 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3dcd9-2e4f-4460-8ec1-7a0beb20297e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.862129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.864955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e6c3dcd9-2e4f-4460-8ec1-7a0beb20297e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:22.866398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e6c3dcd9-2e4f-4460-8ec1-7a0beb20297e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:22.869632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:22.932094 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d54cd2-8107-408e-9e77-24f1eb6de10a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:22.947210 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 309/622] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:22.948346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3dcd9-2e4f-4460-8ec1-7a0beb20297e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:22.973594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3a96-6501-4978-b317-5828d115637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:22.974431 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3a96-6501-4978-b317-5828d115637e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:22.974793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3a96-6501-4978-b317-5828d115637e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:22.975171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e3a96-6501-4978-b317-5828d115637e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:22.989704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e3a96-6501-4978-b317-5828d115637e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:22.992081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875e3a96-6501-4978-b317-5828d115637e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-875e3a96-6501-4978-b317-5828d115637e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:23.012104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:23.013014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:23.013903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:23.013903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:23.013903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:23.013903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:23.016158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 314/623] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:23.017239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3a96-6501-4978-b317-5828d115637e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:23.097303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3dcd9-2e4f-4460-8ec1-7a0beb20297e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:23.127932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:23.140677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e3a96-6501-4978-b317-5828d115637e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:23.152307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ada7-5b12-44e7-b580-6cebdf085779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:23.153905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ada7-5b12-44e7-b580-6cebdf085779 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:23.154377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ada7-5b12-44e7-b580-6cebdf085779 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:23.154860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796ada7-5b12-44e7-b580-6cebdf085779 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:23.156061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796ada7-5b12-44e7-b580-6cebdf085779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:23.156999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796ada7-5b12-44e7-b580-6cebdf085779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:23.159129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0796ada7-5b12-44e7-b580-6cebdf085779 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:23.171173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:23.177327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 310/624] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:23.178391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ada7-5b12-44e7-b580-6cebdf085779 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:23.185109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5e770-8af8-4850-b45b-645fe01ae995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:23.186113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5e770-8af8-4850-b45b-645fe01ae995 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:23.186500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5e770-8af8-4850-b45b-645fe01ae995 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:23.186880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5e770-8af8-4850-b45b-645fe01ae995 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:23.200021 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5e770-8af8-4850-b45b-645fe01ae995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-1fa5e770-8af8-4850-b45b-645fe01ae995 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:23.212159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:23.213378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:23.214216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:23.218903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 315/625] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:23.220426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5e770-8af8-4850-b45b-645fe01ae995 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:23.312824 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0796ada7-5b12-44e7-b580-6cebdf085779 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:23.340220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5e770-8af8-4850-b45b-645fe01ae995 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:23.363999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97c353-4bca-4c4b-9f54-700687dafc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:23.365804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97c353-4bca-4c4b-9f54-700687dafc9a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:23.366251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97c353-4bca-4c4b-9f54-700687dafc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:23.366680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97c353-4bca-4c4b-9f54-700687dafc9a None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:23.367863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97c353-4bca-4c4b-9f54-700687dafc9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:23.368580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97c353-4bca-4c4b-9f54-700687dafc9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:23.370991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97c353-4bca-4c4b-9f54-700687dafc9a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:23.381501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc825-f1e1-4314-844c-bf452d7738e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:23.382055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc825-f1e1-4314-844c-bf452d7738e6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:23.382473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc825-f1e1-4314-844c-bf452d7738e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:23.382827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6fc825-f1e1-4314-844c-bf452d7738e6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:23.390609 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 311/626] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:23.391866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97c353-4bca-4c4b-9f54-700687dafc9a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:23.399028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fc825-f1e1-4314-844c-bf452d7738e6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:23.399028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6fc825-f1e1-4314-844c-bf452d7738e6 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-6f6fc825-f1e1-4314-844c-bf452d7738e6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:23.414989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:23.415983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:23.416983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:23.416983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:23.416983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:23.416983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:23.416983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:23.416983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:23.416983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:23.416983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:23.416983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:23.416983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:23.420032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 316/627] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:23.421035 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc825-f1e1-4314-844c-bf452d7738e6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:23.442553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:23.479295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:23.534836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97c353-4bca-4c4b-9f54-700687dafc9a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:23.545850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6fc825-f1e1-4314-844c-bf452d7738e6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:23.581102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1dc4-c5be-4bdb-a991-c7e49a177f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:23.583081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1dc4-c5be-4bdb-a991-c7e49a177f39 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:23.583989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1dc4-c5be-4bdb-a991-c7e49a177f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:23.584566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d1dc4-c5be-4bdb-a991-c7e49a177f39 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:23.585544 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d1dc4-c5be-4bdb-a991-c7e49a177f39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:23.586067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d1dc4-c5be-4bdb-a991-c7e49a177f39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:23.587947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d1dc4-c5be-4bdb-a991-c7e49a177f39 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:23.593125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcde197-b8d7-438b-83cb-1132fb2d0617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:23.593928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcde197-b8d7-438b-83cb-1132fb2d0617 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:23.594213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcde197-b8d7-438b-83cb-1132fb2d0617 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:23.594482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcde197-b8d7-438b-83cb-1132fb2d0617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:23.603688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcde197-b8d7-438b-83cb-1132fb2d0617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:23.603961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcde197-b8d7-438b-83cb-1132fb2d0617 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:23.604160 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 312/628] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:23.605422 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1dc4-c5be-4bdb-a991-c7e49a177f39 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-5fcde197-b8d7-438b-83cb-1132fb2d0617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:23.621605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:23.622601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:23.623599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:23.623599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:23.623599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:23.623599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:23.623599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:23.623599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:23.623599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:23.623599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:23.623599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 317/629] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:23.624123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcde197-b8d7-438b-83cb-1132fb2d0617 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:23.708418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:23.729926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d1dc4-c5be-4bdb-a991-c7e49a177f39 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:23.748989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcde197-b8d7-438b-83cb-1132fb2d0617 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:23.755074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:23.772134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96f687-260c-49d9-814d-0db7e8d0559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:23.773205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96f687-260c-49d9-814d-0db7e8d0559c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:23.773708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96f687-260c-49d9-814d-0db7e8d0559c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:23.774200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f96f687-260c-49d9-814d-0db7e8d0559c None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:23.775400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96f687-260c-49d9-814d-0db7e8d0559c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:23.776010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96f687-260c-49d9-814d-0db7e8d0559c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:23.777733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f96f687-260c-49d9-814d-0db7e8d0559c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:23.799143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc819-59df-4bd4-84b5-4c3a2237eb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:23.800507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc819-59df-4bd4-84b5-4c3a2237eb71 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:23.801221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc819-59df-4bd4-84b5-4c3a2237eb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:23.801789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ecc819-59df-4bd4-84b5-4c3a2237eb71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:23.804569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 313/630] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:23.805746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96f687-260c-49d9-814d-0db7e8d0559c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:23.815198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecc819-59df-4bd4-84b5-4c3a2237eb71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:23.817264 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ecc819-59df-4bd4-84b5-4c3a2237eb71 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-57ecc819-59df-4bd4-84b5-4c3a2237eb71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:23.839578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:23.840525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:23.841432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:23.841432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:23.841432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:23.841432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:23.847296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 318/631] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:23.849256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc819-59df-4bd4-84b5-4c3a2237eb71 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:23.930696 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f96f687-260c-49d9-814d-0db7e8d0559c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:23.961759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ecc819-59df-4bd4-84b5-4c3a2237eb71 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:23.965475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536af828-4373-44e2-8f97-f1dc6341c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:23.966128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536af828-4373-44e2-8f97-f1dc6341c69c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:23.966410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536af828-4373-44e2-8f97-f1dc6341c69c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:23.966683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536af828-4373-44e2-8f97-f1dc6341c69c None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:23.967490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536af828-4373-44e2-8f97-f1dc6341c69c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:23.967800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536af828-4373-44e2-8f97-f1dc6341c69c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:23.969237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536af828-4373-44e2-8f97-f1dc6341c69c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:23.986315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 314/632] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:23.986315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536af828-4373-44e2-8f97-f1dc6341c69c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:23.993163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:24.006030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac28d4-f4f2-4a58-b3f1-d64ab82fa767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:24.006775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac28d4-f4f2-4a58-b3f1-d64ab82fa767 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.007151 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac28d4-f4f2-4a58-b3f1-d64ab82fa767 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.007493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac28d4-f4f2-4a58-b3f1-d64ab82fa767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.031778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:24.078848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac28d4-f4f2-4a58-b3f1-d64ab82fa767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:24.080377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac28d4-f4f2-4a58-b3f1-d64ab82fa767 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:24.094752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536af828-4373-44e2-8f97-f1dc6341c69c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:24.130723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0882dd55-fd57-479d-87ed-809f861fc9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:24.131411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882dd55-fd57-479d-87ed-809f861fc9bf None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.131692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882dd55-fd57-479d-87ed-809f861fc9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.131965 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882dd55-fd57-479d-87ed-809f861fc9bf None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.132682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882dd55-fd57-479d-87ed-809f861fc9bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:24.132987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882dd55-fd57-479d-87ed-809f861fc9bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:24.134526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0882dd55-fd57-479d-87ed-809f861fc9bf None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:24.148037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 315/633] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:24.149436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8fb26-1db2-423a-b880-99b8f49951de None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.149729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8fb26-1db2-423a-b880-99b8f49951de None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.150011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8fb26-1db2-423a-b880-99b8f49951de None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.151292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 316/634] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:24.151968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8fb26-1db2-423a-b880-99b8f49951de None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:24.197649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 319/635] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:24.197649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e834fb-4f3f-413e-8cc8-e20bfad8e2f5 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.197649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e834fb-4f3f-413e-8cc8-e20bfad8e2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.197649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e834fb-4f3f-413e-8cc8-e20bfad8e2f5 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.197649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 320/636] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:24.197649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e834fb-4f3f-413e-8cc8-e20bfad8e2f5 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:24.226592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:24.250495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:24.255295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8fb26-1db2-423a-b880-99b8f49951de None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:24.288330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56140b2e-8f5e-460c-84fe-2f2b90ade39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:24.289224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56140b2e-8f5e-460c-84fe-2f2b90ade39e None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.289508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56140b2e-8f5e-460c-84fe-2f2b90ade39e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.289783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56140b2e-8f5e-460c-84fe-2f2b90ade39e None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/4bfb2a63f46a4a419da65805253ef7ac/roles/a1c2e9dff7da4c458034685fb77fed4b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.303773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56140b2e-8f5e-460c-84fe-2f2b90ade39e None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=4bfb2a63f46a4a419da65805253ef7ac, role_id=a1c2e9dff7da4c458034685fb77fed4b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:24.304091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e834fb-4f3f-413e-8cc8-e20bfad8e2f5 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:24.305250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56140b2e-8f5e-460c-84fe-2f2b90ade39e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:24.318185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 317/637] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:24 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/4bfb2a63f46a4a419da65805253ef7ac/roles/a1c2e9dff7da4c458034685fb77fed4b => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:24.319465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642fed3-2bb2-41f4-8705-4e378eaf97ef None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.319742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642fed3-2bb2-41f4-8705-4e378eaf97ef None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.320017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642fed3-2bb2-41f4-8705-4e378eaf97ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.339169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-6642fed3-2bb2-41f4-8705-4e378eaf97ef None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:24.340550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6642fed3-2bb2-41f4-8705-4e378eaf97ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:24.355065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aefba2-4f40-4e18-979b-5d26e30d13cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:24.355932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aefba2-4f40-4e18-979b-5d26e30d13cf None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.356320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aefba2-4f40-4e18-979b-5d26e30d13cf None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.356696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aefba2-4f40-4e18-979b-5d26e30d13cf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.365688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aefba2-4f40-4e18-979b-5d26e30d13cf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:24.367402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aefba2-4f40-4e18-979b-5d26e30d13cf None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-87aefba2-4f40-4e18-979b-5d26e30d13cf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:24.383368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:24.384664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:24.385912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:24.385912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:24.385912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:24.385912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:24.385912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:24.385912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:24.385912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:24.385912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:24.385912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:24.385912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:24.391374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 321/638] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:24.391374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aefba2-4f40-4e18-979b-5d26e30d13cf None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:24.421957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 318/639] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:24.423380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5031d6-9e94-4fc3-bea0-01a0daa9205a None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.423726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5031d6-9e94-4fc3-bea0-01a0daa9205a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.424066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5031d6-9e94-4fc3-bea0-01a0daa9205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.452535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-2e5031d6-9e94-4fc3-bea0-01a0daa9205a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:24.454061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2e5031d6-9e94-4fc3-bea0-01a0daa9205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:24.494483 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:24.514286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aefba2-4f40-4e18-979b-5d26e30d13cf None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:24.539040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 319/640] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:24.539040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5031d6-9e94-4fc3-bea0-01a0daa9205a None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:24.548882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:24.559473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619bdf2-5da6-46a9-804e-2a0b85137107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:24.562253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619bdf2-5da6-46a9-804e-2a0b85137107 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.562716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619bdf2-5da6-46a9-804e-2a0b85137107 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.563090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619bdf2-5da6-46a9-804e-2a0b85137107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.575102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619bdf2-5da6-46a9-804e-2a0b85137107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:24.576592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1619bdf2-5da6-46a9-804e-2a0b85137107 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-1619bdf2-5da6-46a9-804e-2a0b85137107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:24.594650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:24.595626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:24.596501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:24.596501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:24.596501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:24.596501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:24.596501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 322/641] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:24.597678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619bdf2-5da6-46a9-804e-2a0b85137107 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:24.655501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5031d6-9e94-4fc3-bea0-01a0daa9205a None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:24.694717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4033c7-27da-4db5-8ea4-56b386ca5c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:24.695883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4033c7-27da-4db5-8ea4-56b386ca5c9b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.696362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4033c7-27da-4db5-8ea4-56b386ca5c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.696658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4033c7-27da-4db5-8ea4-56b386ca5c9b None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.697591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4033c7-27da-4db5-8ea4-56b386ca5c9b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:24.697997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4033c7-27da-4db5-8ea4-56b386ca5c9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:24.699576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4033c7-27da-4db5-8ea4-56b386ca5c9b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:24.704827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1619bdf2-5da6-46a9-804e-2a0b85137107 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:24.717782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 320/642] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:24.718804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4033c7-27da-4db5-8ea4-56b386ca5c9b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:24.747464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c9ab6-5344-479d-b65e-fb3f8b72be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:24.748279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c9ab6-5344-479d-b65e-fb3f8b72be3f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.748567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c9ab6-5344-479d-b65e-fb3f8b72be3f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.748865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c9ab6-5344-479d-b65e-fb3f8b72be3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.750880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:24.762600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c9ab6-5344-479d-b65e-fb3f8b72be3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-246c9ab6-5344-479d-b65e-fb3f8b72be3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:24.771253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:24.772485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:24.773543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:24.775392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 323/643] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:24.776140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c9ab6-5344-479d-b65e-fb3f8b72be3f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:24.802475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:24.839413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4033c7-27da-4db5-8ea4-56b386ca5c9b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:24.877942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c30f82-7b8b-4842-9342-f95ea7fc17f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:24.878812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c30f82-7b8b-4842-9342-f95ea7fc17f6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.879159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c30f82-7b8b-4842-9342-f95ea7fc17f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.879409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c30f82-7b8b-4842-9342-f95ea7fc17f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.886598 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c9ab6-5344-479d-b65e-fb3f8b72be3f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:24.890542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c30f82-7b8b-4842-9342-f95ea7fc17f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-02c30f82-7b8b-4842-9342-f95ea7fc17f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:24.898505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:24.899459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:24.900347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 321/644] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:24.901143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c30f82-7b8b-4842-9342-f95ea7fc17f6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:24.931518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c291cc-5215-495d-b0ff-a1134d50365c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:24.932604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c291cc-5215-495d-b0ff-a1134d50365c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:24.932892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c291cc-5215-495d-b0ff-a1134d50365c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:24.933203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c291cc-5215-495d-b0ff-a1134d50365c None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:24.933932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c291cc-5215-495d-b0ff-a1134d50365c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:24.934251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c291cc-5215-495d-b0ff-a1134d50365c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:24.935674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c291cc-5215-495d-b0ff-a1134d50365c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:24.951926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 324/645] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:24.951926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c291cc-5215-495d-b0ff-a1134d50365c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.005966 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:25.013788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c30f82-7b8b-4842-9342-f95ea7fc17f6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.043501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:25.053765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e15428-95cd-4cec-96da-01333c25fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.053954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c291cc-5215-495d-b0ff-a1134d50365c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.054417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e15428-95cd-4cec-96da-01333c25fc12 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.054700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e15428-95cd-4cec-96da-01333c25fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.054997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e15428-95cd-4cec-96da-01333c25fc12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.088874 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03843268-ef07-42c8-8f94-f478c1e884ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.089709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843268-ef07-42c8-8f94-f478c1e884ad None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.090089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843268-ef07-42c8-8f94-f478c1e884ad None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.090466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03843268-ef07-42c8-8f94-f478c1e884ad None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.091355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03843268-ef07-42c8-8f94-f478c1e884ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:25.091764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03843268-ef07-42c8-8f94-f478c1e884ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.093269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03843268-ef07-42c8-8f94-f478c1e884ad None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.107852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 325/646] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:25.107852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03843268-ef07-42c8-8f94-f478c1e884ad None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.133463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e15428-95cd-4cec-96da-01333c25fc12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.135238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e15428-95cd-4cec-96da-01333c25fc12 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.212686 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03843268-ef07-42c8-8f94-f478c1e884ad None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.229537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:25.247651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 322/647] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:25.247832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc978b-1b78-43eb-9b71-0ae60364aec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.248462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc978b-1b78-43eb-9b71-0ae60364aec1 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.248750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc978b-1b78-43eb-9b71-0ae60364aec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.249030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc978b-1b78-43eb-9b71-0ae60364aec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.249450 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e15428-95cd-4cec-96da-01333c25fc12 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.249791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc978b-1b78-43eb-9b71-0ae60364aec1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:25.250102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc978b-1b78-43eb-9b71-0ae60364aec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.251526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc978b-1b78-43eb-9b71-0ae60364aec1 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.260247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 326/648] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:25.261043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc978b-1b78-43eb-9b71-0ae60364aec1 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.283661 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:25.361303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e15428-95cd-4cec-96da-01333c25fc12 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.363923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc978b-1b78-43eb-9b71-0ae60364aec1 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.397910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42de47d-fcab-4aaa-b863-bbeb8f2fb978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.398100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d2d6d-eef7-45ae-8358-8dbf7c7ecb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.398863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d2d6d-eef7-45ae-8358-8dbf7c7ecb9e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.399009 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42de47d-fcab-4aaa-b863-bbeb8f2fb978 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.399299 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42de47d-fcab-4aaa-b863-bbeb8f2fb978 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.399388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d2d6d-eef7-45ae-8358-8dbf7c7ecb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.399567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3d2d6d-eef7-45ae-8358-8dbf7c7ecb9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.399670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42de47d-fcab-4aaa-b863-bbeb8f2fb978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.406677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d2d6d-eef7-45ae-8358-8dbf7c7ecb9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.408296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3d2d6d-eef7-45ae-8358-8dbf7c7ecb9e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.410686 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42de47d-fcab-4aaa-b863-bbeb8f2fb978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.412180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42de47d-fcab-4aaa-b863-bbeb8f2fb978 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-6c3d2d6d-eef7-45ae-8358-8dbf7c7ecb9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:25.423395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:25.426369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:25.427580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:25.427580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:25.427580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:25.427580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:25.427580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:25.427580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:25.427580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:25.427580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:25.429661 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 323/649] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:25.430285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d2d6d-eef7-45ae-8358-8dbf7c7ecb9e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-b42de47d-fcab-4aaa-b863-bbeb8f2fb978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:25.431349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:25.432196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:25.437715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:25.437715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:25.437715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:25.437715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:25.437715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 327/650] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:25.437715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42de47d-fcab-4aaa-b863-bbeb8f2fb978 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.468999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:25.532402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:25.545895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3d2d6d-eef7-45ae-8358-8dbf7c7ecb9e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.556579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42de47d-fcab-4aaa-b863-bbeb8f2fb978 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.580527 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54af5b-c5b6-4dae-8596-75e0696ed323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.581324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54af5b-c5b6-4dae-8596-75e0696ed323 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.582323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54af5b-c5b6-4dae-8596-75e0696ed323 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.582602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf54af5b-c5b6-4dae-8596-75e0696ed323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.592867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cde97a-4d0f-4b3a-8255-fd69807a6883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.593664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cde97a-4d0f-4b3a-8255-fd69807a6883 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.593947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cde97a-4d0f-4b3a-8255-fd69807a6883 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.594224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cde97a-4d0f-4b3a-8255-fd69807a6883 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.596370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54af5b-c5b6-4dae-8596-75e0696ed323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.598860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf54af5b-c5b6-4dae-8596-75e0696ed323 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.606035 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cde97a-4d0f-4b3a-8255-fd69807a6883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.607514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cde97a-4d0f-4b3a-8255-fd69807a6883 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-cf54af5b-c5b6-4dae-8596-75e0696ed323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:25.618084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:25.619209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:25.624993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:25.624993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:25.624993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:25.624993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:25.624993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 324/651] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:25.624993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54af5b-c5b6-4dae-8596-75e0696ed323 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-a6cde97a-4d0f-4b3a-8255-fd69807a6883 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:25.629248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:25.630240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:25.631480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:25.631480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:25.631480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:25.631480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:25.637119 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 328/652] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:25.637119 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cde97a-4d0f-4b3a-8255-fd69807a6883 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.724207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:25.730642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf54af5b-c5b6-4dae-8596-75e0696ed323 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.745222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cde97a-4d0f-4b3a-8255-fd69807a6883 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.766205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2769c-2f6f-4848-b66a-f25ce2f2e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.767165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2769c-2f6f-4848-b66a-f25ce2f2e62f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.767165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2769c-2f6f-4848-b66a-f25ce2f2e62f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.767433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee2769c-2f6f-4848-b66a-f25ce2f2e62f None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.768217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2769c-2f6f-4848-b66a-f25ce2f2e62f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:25.768614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2769c-2f6f-4848-b66a-f25ce2f2e62f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.770997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee2769c-2f6f-4848-b66a-f25ce2f2e62f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.780958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:25.791056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 325/653] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:25.791056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2769c-2f6f-4848-b66a-f25ce2f2e62f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.795138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f119-d87c-4208-b948-b716ff13d508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.795903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f119-d87c-4208-b948-b716ff13d508 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.796194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f119-d87c-4208-b948-b716ff13d508 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.796477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064f119-d87c-4208-b948-b716ff13d508 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.797308 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064f119-d87c-4208-b948-b716ff13d508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:25.797688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064f119-d87c-4208-b948-b716ff13d508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.799136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064f119-d87c-4208-b948-b716ff13d508 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.819681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 329/654] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:25.819681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f119-d87c-4208-b948-b716ff13d508 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.901435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee2769c-2f6f-4848-b66a-f25ce2f2e62f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.934820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064f119-d87c-4208-b948-b716ff13d508 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:25.936729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31b66-bd81-428a-8823-a67a5844d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.938190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31b66-bd81-428a-8823-a67a5844d0ec None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.938481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31b66-bd81-428a-8823-a67a5844d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.938764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da31b66-bd81-428a-8823-a67a5844d0ec None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.939538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da31b66-bd81-428a-8823-a67a5844d0ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:25.939853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da31b66-bd81-428a-8823-a67a5844d0ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.941495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da31b66-bd81-428a-8823-a67a5844d0ec None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.959896 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 326/655] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:25.959896 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31b66-bd81-428a-8823-a67a5844d0ec None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.970554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15938ce-887d-4af9-97a7-fa699f58eacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:25.971606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15938ce-887d-4af9-97a7-fa699f58eacb None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:25.971911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15938ce-887d-4af9-97a7-fa699f58eacb None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:25.972693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15938ce-887d-4af9-97a7-fa699f58eacb None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:25.973741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15938ce-887d-4af9-97a7-fa699f58eacb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:25.974388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15938ce-887d-4af9-97a7-fa699f58eacb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:25.975911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15938ce-887d-4af9-97a7-fa699f58eacb None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:25.995109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 330/656] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:25.995968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15938ce-887d-4af9-97a7-fa699f58eacb None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:25.998605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.029793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.075800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da31b66-bd81-428a-8823-a67a5844d0ec None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.103010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15938ce-887d-4af9-97a7-fa699f58eacb None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.111648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015b73a-8c09-43bc-9d66-c67e24bdd338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.112395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015b73a-8c09-43bc-9d66-c67e24bdd338 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.113801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015b73a-8c09-43bc-9d66-c67e24bdd338 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.113801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015b73a-8c09-43bc-9d66-c67e24bdd338 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.114948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015b73a-8c09-43bc-9d66-c67e24bdd338 None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=5a82fed4ff8845919b1da05f7e8d1d72) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:26.115380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015b73a-8c09-43bc-9d66-c67e24bdd338 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.116989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015b73a-8c09-43bc-9d66-c67e24bdd338 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.130993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 327/657] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/role_assignments?user.id=5a82fed4ff8845919b1da05f7e8d1d72&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:26.130993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015b73a-8c09-43bc-9d66-c67e24bdd338 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.152366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2694b-5e44-48cc-a92e-1dcb1e1cc3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.153291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2694b-5e44-48cc-a92e-1dcb1e1cc3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.153638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2694b-5e44-48cc-a92e-1dcb1e1cc3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.153979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2694b-5e44-48cc-a92e-1dcb1e1cc3c7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.163364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2694b-5e44-48cc-a92e-1dcb1e1cc3c7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.165051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd2694b-5e44-48cc-a92e-1dcb1e1cc3c7 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-ebd2694b-5e44-48cc-a92e-1dcb1e1cc3c7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:26.185254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:26.186350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:26.187530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:26.187530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:26.187530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:26.187530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:26.187530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:26.187530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:26.187530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:26.187530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:26.187530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 21 04:05:26.187530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:26.190050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 331/658] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:26.190050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2694b-5e44-48cc-a92e-1dcb1e1cc3c7 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.265319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.274738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015b73a-8c09-43bc-9d66-c67e24bdd338 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.307007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.314825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2694b-5e44-48cc-a92e-1dcb1e1cc3c7 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.323523 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a0930-6eda-4d56-8837-b9471b3e4602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.324451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a0930-6eda-4d56-8837-b9471b3e4602 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.324820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a0930-6eda-4d56-8837-b9471b3e4602 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.325516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79a0930-6eda-4d56-8837-b9471b3e4602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.333133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a0930-6eda-4d56-8837-b9471b3e4602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.334609 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79a0930-6eda-4d56-8837-b9471b3e4602 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-c79a0930-6eda-4d56-8837-b9471b3e4602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:26.352303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:26.353418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:26.354500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:26.354500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:26.354500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:26.354500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:26.354500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:26.354500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:26.354500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:26.354500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:26.355756 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 328/659] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:26.356851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a0930-6eda-4d56-8837-b9471b3e4602 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.363364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb4743-dd09-4c34-addc-7b9a7f2c8ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.364364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb4743-dd09-4c34-addc-7b9a7f2c8ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.364706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb4743-dd09-4c34-addc-7b9a7f2c8ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.365041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb4743-dd09-4c34-addc-7b9a7f2c8ab4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.373974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb4743-dd09-4c34-addc-7b9a7f2c8ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.375573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb4743-dd09-4c34-addc-7b9a7f2c8ab4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-caeb4743-dd09-4c34-addc-7b9a7f2c8ab4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:26.391947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:26.393121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:26.394321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:26.394321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:26.394321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:26.394321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:26.394321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:26.394321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:26.394321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:26.394321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:26.394321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 21 04:05:26.394321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:26.395226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 332/660] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:26.396000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb4743-dd09-4c34-addc-7b9a7f2c8ab4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.477643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79a0930-6eda-4d56-8837-b9471b3e4602 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.514763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06476217-3469-4ef6-bbe9-71877c0123a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.515745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06476217-3469-4ef6-bbe9-71877c0123a7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.515862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb4743-dd09-4c34-addc-7b9a7f2c8ab4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.516273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06476217-3469-4ef6-bbe9-71877c0123a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.516696 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06476217-3469-4ef6-bbe9-71877c0123a7 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.517742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06476217-3469-4ef6-bbe9-71877c0123a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:26.518298 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06476217-3469-4ef6-bbe9-71877c0123a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.519883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06476217-3469-4ef6-bbe9-71877c0123a7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.537992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 329/661] 10.222.0.48 () {56 vars in 1137 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:26.538647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06476217-3469-4ef6-bbe9-71877c0123a7 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.542933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.557064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f114b3-4f65-4a6f-8e76-249023aa6e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.557729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f114b3-4f65-4a6f-8e76-249023aa6e63 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.558010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f114b3-4f65-4a6f-8e76-249023aa6e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.558283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f114b3-4f65-4a6f-8e76-249023aa6e63 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.559106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f114b3-4f65-4a6f-8e76-249023aa6e63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:26.559415 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f114b3-4f65-4a6f-8e76-249023aa6e63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.560848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f114b3-4f65-4a6f-8e76-249023aa6e63 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.577873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 333/662] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:26.579046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c581-032a-424a-80aa-88f1a429302a None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.579336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c581-032a-424a-80aa-88f1a429302a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.579610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f221c581-032a-424a-80aa-88f1a429302a None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.581004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 334/663] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:26.581593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221c581-032a-424a-80aa-88f1a429302a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.590083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.654368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06476217-3469-4ef6-bbe9-71877c0123a7 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.688867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f221c581-032a-424a-80aa-88f1a429302a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.694595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df8472-171c-475d-a083-02b594b50b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.695529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df8472-171c-475d-a083-02b594b50b6b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.695960 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df8472-171c-475d-a083-02b594b50b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.696512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df8472-171c-475d-a083-02b594b50b6b None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.697517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df8472-171c-475d-a083-02b594b50b6b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:26.697976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df8472-171c-475d-a083-02b594b50b6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.699784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df8472-171c-475d-a083-02b594b50b6b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.725175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ca418-10f1-4d9a-a2ee-3e1f4dababbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.725737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 330/664] 10.222.0.48 () {56 vars in 1139 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:26.725852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ca418-10f1-4d9a-a2ee-3e1f4dababbe None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.726073 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ca418-10f1-4d9a-a2ee-3e1f4dababbe None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.726355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ca418-10f1-4d9a-a2ee-3e1f4dababbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.727167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df8472-171c-475d-a083-02b594b50b6b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:26.786085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.805787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ca418-10f1-4d9a-a2ee-3e1f4dababbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.807360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ca418-10f1-4d9a-a2ee-3e1f4dababbe None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.837471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:26.841621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df8472-171c-475d-a083-02b594b50b6b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:26.882799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521afb71-4713-4152-9057-a2b814611182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:26.883478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521afb71-4713-4152-9057-a2b814611182 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.883765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521afb71-4713-4152-9057-a2b814611182 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.884044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521afb71-4713-4152-9057-a2b814611182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.884870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521afb71-4713-4152-9057-a2b814611182 None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=92407a5a276247e79d2abe41fee54c33) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:26.885181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521afb71-4713-4152-9057-a2b814611182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:26.886936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521afb71-4713-4152-9057-a2b814611182 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:26.892784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 331/665] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/role_assignments?user.id=92407a5a276247e79d2abe41fee54c33&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:26.893761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed4c2-fc95-48a6-89c7-44e668c8abad None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:26.894722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed4c2-fc95-48a6-89c7-44e668c8abad None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:26.895056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ed4c2-fc95-48a6-89c7-44e668c8abad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:26.913540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-f67ed4c2-fc95-48a6-89c7-44e668c8abad None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:26.914775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f67ed4c2-fc95-48a6-89c7-44e668c8abad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:26.941103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 335/666] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:26.941103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ca418-10f1-4d9a-a2ee-3e1f4dababbe None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.016252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 332/667] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:27.017454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed4c2-fc95-48a6-89c7-44e668c8abad None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.050367 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.070751 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ca418-10f1-4d9a-a2ee-3e1f4dababbe None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.107774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983a623-eea7-436c-a47d-398ee1ad3b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.108575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983a623-eea7-436c-a47d-398ee1ad3b50 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.108959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983a623-eea7-436c-a47d-398ee1ad3b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.109339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983a623-eea7-436c-a47d-398ee1ad3b50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.140765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.148864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ed4c2-fc95-48a6-89c7-44e668c8abad None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.185687 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f99e3-ec78-4c49-b866-5119e47ed496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.186577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f99e3-ec78-4c49-b866-5119e47ed496 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.186988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f99e3-ec78-4c49-b866-5119e47ed496 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.187336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02f99e3-ec78-4c49-b866-5119e47ed496 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.196922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983a623-eea7-436c-a47d-398ee1ad3b50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.198680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f99e3-ec78-4c49-b866-5119e47ed496 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.198825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983a623-eea7-436c-a47d-398ee1ad3b50 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.200349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02f99e3-ec78-4c49-b866-5119e47ed496 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-e02f99e3-ec78-4c49-b866-5119e47ed496 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:27.224608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:27.225573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:27.226702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:27.226702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:27.226702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:27.226702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:27.226702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 333/668] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:27.231712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f99e3-ec78-4c49-b866-5119e47ed496 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.306600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.334874 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 336/669] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:27.336609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983a623-eea7-436c-a47d-398ee1ad3b50 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.350204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02f99e3-ec78-4c49-b866-5119e47ed496 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.392658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f5496-9317-40ff-b42e-3bdbdcd64107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.394237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5496-9317-40ff-b42e-3bdbdcd64107 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.394813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5496-9317-40ff-b42e-3bdbdcd64107 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.395263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f5496-9317-40ff-b42e-3bdbdcd64107 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.410316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4f5496-9317-40ff-b42e-3bdbdcd64107 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-aa4f5496-9317-40ff-b42e-3bdbdcd64107 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:27.421271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:27.422520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:27.423648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:27.427305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 334/670] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:27.428431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f5496-9317-40ff-b42e-3bdbdcd64107 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.465446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983a623-eea7-436c-a47d-398ee1ad3b50 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.499324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.502489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19322622-9ced-490e-b11e-b3063cd46d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.503457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19322622-9ced-490e-b11e-b3063cd46d60 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.503786 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19322622-9ced-490e-b11e-b3063cd46d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.504162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19322622-9ced-490e-b11e-b3063cd46d60 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.505047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19322622-9ced-490e-b11e-b3063cd46d60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:27.505460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19322622-9ced-490e-b11e-b3063cd46d60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.507041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19322622-9ced-490e-b11e-b3063cd46d60 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.524627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 337/671] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:27.525665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19322622-9ced-490e-b11e-b3063cd46d60 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.557400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f5496-9317-40ff-b42e-3bdbdcd64107 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.572603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.603990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ced35-b050-45ba-9d32-9c2824e95b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.606113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ced35-b050-45ba-9d32-9c2824e95b04 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.606557 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ced35-b050-45ba-9d32-9c2824e95b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.607007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ced35-b050-45ba-9d32-9c2824e95b04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.622380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ced35-b050-45ba-9d32-9c2824e95b04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.624121 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ced35-b050-45ba-9d32-9c2824e95b04 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.638314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19322622-9ced-490e-b11e-b3063cd46d60 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-a22ced35-b050-45ba-9d32-9c2824e95b04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:27.653268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:27.654397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:27.655635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:27.655635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:27.655635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:27.655635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:27.658069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 335/672] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:27.659504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ced35-b050-45ba-9d32-9c2824e95b04 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.681147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884a61d-ca75-49cc-936e-a5a0a44f755c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.681824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884a61d-ca75-49cc-936e-a5a0a44f755c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.682106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884a61d-ca75-49cc-936e-a5a0a44f755c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.682380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884a61d-ca75-49cc-936e-a5a0a44f755c None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.683224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884a61d-ca75-49cc-936e-a5a0a44f755c None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:27.683460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884a61d-ca75-49cc-936e-a5a0a44f755c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.684938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884a61d-ca75-49cc-936e-a5a0a44f755c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.694829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 338/673] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:27.695798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884a61d-ca75-49cc-936e-a5a0a44f755c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.740199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.798070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ced35-b050-45ba-9d32-9c2824e95b04 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.805614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884a61d-ca75-49cc-936e-a5a0a44f755c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:27.809586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:27.844280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86e8c1-f710-443f-9e7a-817c761771a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.845092 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e8c1-f710-443f-9e7a-817c761771a5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.845374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e8c1-f710-443f-9e7a-817c761771a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.845644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e8c1-f710-443f-9e7a-817c761771a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.846362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86e8c1-f710-443f-9e7a-817c761771a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:27.846721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86e8c1-f710-443f-9e7a-817c761771a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.849097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86e8c1-f710-443f-9e7a-817c761771a5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.853531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed2ee-7828-47d0-a273-fa77fb7ffda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:27.854603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed2ee-7828-47d0-a273-fa77fb7ffda5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:27.855145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed2ee-7828-47d0-a273-fa77fb7ffda5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:27.855628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ed2ee-7828-47d0-a273-fa77fb7ffda5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:27.865470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ed2ee-7828-47d0-a273-fa77fb7ffda5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:27.867220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 339/674] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:27.867946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86e8c1-f710-443f-9e7a-817c761771a5 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:27.868076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ed2ee-7828-47d0-a273-fa77fb7ffda5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-698ed2ee-7828-47d0-a273-fa77fb7ffda5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:27.888418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:27.889355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:27.890295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:27.890295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:27.890295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:27.890295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:27.890295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:27.890295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:27.890295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:27.890295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:27.892807 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 336/675] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:27.894134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed2ee-7828-47d0-a273-fa77fb7ffda5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:28.004406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86e8c1-f710-443f-9e7a-817c761771a5 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:28.005112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ed2ee-7828-47d0-a273-fa77fb7ffda5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:28.023557 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:28.046120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0ff77-088c-4533-b4f7-d44cdf754684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:28.047581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0ff77-088c-4533-b4f7-d44cdf754684 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.048149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0ff77-088c-4533-b4f7-d44cdf754684 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.048722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c0ff77-088c-4533-b4f7-d44cdf754684 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.049064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070661-9720-4687-972b-cb786e4e9744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:28.049855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070661-9720-4687-972b-cb786e4e9744 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.050159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070661-9720-4687-972b-cb786e4e9744 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.050980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35070661-9720-4687-972b-cb786e4e9744 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.059095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0ff77-088c-4533-b4f7-d44cdf754684 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:28.061721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c0ff77-088c-4533-b4f7-d44cdf754684 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:28.061995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070661-9720-4687-972b-cb786e4e9744 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:28.063566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35070661-9720-4687-972b-cb786e4e9744 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-60c0ff77-088c-4533-b4f7-d44cdf754684 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:28.079140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:28.080056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:28.080970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:28.080970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:28.080970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:28.080970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:28.080970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:28.080970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:28.080970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:28.080970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-35070661-9720-4687-972b-cb786e4e9744 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:28.082136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:28.082997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:28.084768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:28.084768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:28.084768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:28.084768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:28.084768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 340/676] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:28.084768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070661-9720-4687-972b-cb786e4e9744 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:28.087288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 337/677] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:28.092601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0ff77-088c-4533-b4f7-d44cdf754684 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:28.107944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:28.208015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c0ff77-088c-4533-b4f7-d44cdf754684 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:28.208895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35070661-9720-4687-972b-cb786e4e9744 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:28.245795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68c3de-f302-4186-850a-1019866cca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:28.246888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68c3de-f302-4186-850a-1019866cca2c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.247098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeb76f-0a2e-4382-9238-c0f71a73438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:28.247598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68c3de-f302-4186-850a-1019866cca2c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.247794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeb76f-0a2e-4382-9238-c0f71a73438b None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.248038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeb76f-0a2e-4382-9238-c0f71a73438b None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.248318 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eeb76f-0a2e-4382-9238-c0f71a73438b None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.248682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68c3de-f302-4186-850a-1019866cca2c None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.249109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeb76f-0a2e-4382-9238-c0f71a73438b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:28.249422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeb76f-0a2e-4382-9238-c0f71a73438b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:28.250012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68c3de-f302-4186-850a-1019866cca2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:28.250515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68c3de-f302-4186-850a-1019866cca2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:28.250876 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eeb76f-0a2e-4382-9238-c0f71a73438b None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:28.252427 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c68c3de-f302-4186-850a-1019866cca2c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:28.268457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 341/678] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:28.268457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeb76f-0a2e-4382-9238-c0f71a73438b None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:28.271307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 338/679] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:28.272361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68c3de-f302-4186-850a-1019866cca2c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:28.319857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:28.349061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:28.375293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eeb76f-0a2e-4382-9238-c0f71a73438b None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:28.385830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68c3de-f302-4186-850a-1019866cca2c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:28.411762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0ae67-3f5a-4506-a5b5-e24caf54b26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:28.412292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0ae67-3f5a-4506-a5b5-e24caf54b26f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.412579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0ae67-3f5a-4506-a5b5-e24caf54b26f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.412899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd0ae67-3f5a-4506-a5b5-e24caf54b26f None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.413643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0ae67-3f5a-4506-a5b5-e24caf54b26f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:28.413957 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0ae67-3f5a-4506-a5b5-e24caf54b26f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:28.415446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd0ae67-3f5a-4506-a5b5-e24caf54b26f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:28.422568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad487aa-59bd-4085-9356-4b49f142e75e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:28.423252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad487aa-59bd-4085-9356-4b49f142e75e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.423534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad487aa-59bd-4085-9356-4b49f142e75e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.423808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad487aa-59bd-4085-9356-4b49f142e75e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.424631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad487aa-59bd-4085-9356-4b49f142e75e None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=e210e10ee6b649399de11ac719a89718) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:28.424940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad487aa-59bd-4085-9356-4b49f142e75e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:28.426408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad487aa-59bd-4085-9356-4b49f142e75e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:28.433707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 342/680] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:28.433707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0ae67-3f5a-4506-a5b5-e24caf54b26f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:28.437680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 339/681] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:28 2022] GET /identity/v3/role_assignments?user.id=e210e10ee6b649399de11ac719a89718&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:28.442980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbac20-1b0b-4b92-aaae-bc2785af7f21 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.442980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbac20-1b0b-4b92-aaae-bc2785af7f21 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.442980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbac20-1b0b-4b92-aaae-bc2785af7f21 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.444945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 340/682] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:28.445929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbac20-1b0b-4b92-aaae-bc2785af7f21 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:28.569775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbac20-1b0b-4b92-aaae-bc2785af7f21 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:28.571190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd0ae67-3f5a-4506-a5b5-e24caf54b26f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:28.571923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:28.613433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a45c2d-1519-48af-8f17-d5704630b148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:28.614310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a45c2d-1519-48af-8f17-d5704630b148 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.614714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a45c2d-1519-48af-8f17-d5704630b148 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.615117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a45c2d-1519-48af-8f17-d5704630b148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.615988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a45c2d-1519-48af-8f17-d5704630b148 None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=b3b2d5dee6d240558a71331e05035a30) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:28.616352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a45c2d-1519-48af-8f17-d5704630b148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:28.618258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a45c2d-1519-48af-8f17-d5704630b148 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:28.620420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0681570-e866-4a9f-9049-bb2dbc1f8189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:28.621516 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0681570-e866-4a9f-9049-bb2dbc1f8189 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.621803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0681570-e866-4a9f-9049-bb2dbc1f8189 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.622647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0681570-e866-4a9f-9049-bb2dbc1f8189 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.625912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:28.627108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 341/683] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:28 2022] GET /identity/v3/role_assignments?user.id=b3b2d5dee6d240558a71331e05035a30&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:28.634844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609ed1b-fc20-4f86-90f3-27b79b4108ec None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.635089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0681570-e866-4a9f-9049-bb2dbc1f8189 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:28.635089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0681570-e866-4a9f-9049-bb2dbc1f8189 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:28.635458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609ed1b-fc20-4f86-90f3-27b79b4108ec None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.635894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609ed1b-fc20-4f86-90f3-27b79b4108ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.657154 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-b609ed1b-fc20-4f86-90f3-27b79b4108ec None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:28.658409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b609ed1b-fc20-4f86-90f3-27b79b4108ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f0681570-e866-4a9f-9049-bb2dbc1f8189 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:28.665025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:28.666040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:28.666995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 343/684] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:28.673948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0681570-e866-4a9f-9049-bb2dbc1f8189 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:28.755101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 342/685] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:28.774880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609ed1b-fc20-4f86-90f3-27b79b4108ec None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:28.823179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0681570-e866-4a9f-9049-bb2dbc1f8189 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:28.866439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25522b91-d466-4d79-959e-af31ebe61b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:28.866647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25522b91-d466-4d79-959e-af31ebe61b3c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.866881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25522b91-d466-4d79-959e-af31ebe61b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.867188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25522b91-d466-4d79-959e-af31ebe61b3c None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.868047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25522b91-d466-4d79-959e-af31ebe61b3c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:28.868362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25522b91-d466-4d79-959e-af31ebe61b3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:28.869822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25522b91-d466-4d79-959e-af31ebe61b3c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:28.891655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 344/686] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 21 04:05:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:28.898765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25522b91-d466-4d79-959e-af31ebe61b3c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:28.916898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:28.926476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609ed1b-fc20-4f86-90f3-27b79b4108ec None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:28.970837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9311a-e751-4973-81cb-6533e9269674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:28.971806 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9311a-e751-4973-81cb-6533e9269674 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:28.972680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9311a-e751-4973-81cb-6533e9269674 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:28.972965 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9311a-e751-4973-81cb-6533e9269674 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:28.974332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:28.996066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9311a-e751-4973-81cb-6533e9269674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f7c9311a-e751-4973-81cb-6533e9269674 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:29.014250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:29.015281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:29.016140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 343/687] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:29.021903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9311a-e751-4973-81cb-6533e9269674 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.075556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25522b91-d466-4d79-959e-af31ebe61b3c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.127606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259b696-f113-4112-9330-7ffbfc6187da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.128280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259b696-f113-4112-9330-7ffbfc6187da None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.128564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259b696-f113-4112-9330-7ffbfc6187da None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.128836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259b696-f113-4112-9330-7ffbfc6187da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.192806 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9311a-e751-4973-81cb-6533e9269674 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.218231 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259b696-f113-4112-9330-7ffbfc6187da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:29.220072 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259b696-f113-4112-9330-7ffbfc6187da None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:29.244098 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e30ff-9b1b-4d91-9b98-060862edb101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.244778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e30ff-9b1b-4d91-9b98-060862edb101 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.245065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e30ff-9b1b-4d91-9b98-060862edb101 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.245345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e30ff-9b1b-4d91-9b98-060862edb101 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.246361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e30ff-9b1b-4d91-9b98-060862edb101 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:29.246681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e30ff-9b1b-4d91-9b98-060862edb101 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:29.248797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e30ff-9b1b-4d91-9b98-060862edb101 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:29.261955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 344/688] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:29.264013 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7900-65b7-466b-a7d7-899d7da12af7 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.264329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7900-65b7-466b-a7d7-899d7da12af7 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.264601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9e7900-65b7-466b-a7d7-899d7da12af7 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.270805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 345/689] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:29.270805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e7900-65b7-466b-a7d7-899d7da12af7 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.285966 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.296310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.336377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 345/690] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:29.338295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a820c8-1003-4aa9-b1f1-d1fa55f35e1a None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.338796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a820c8-1003-4aa9-b1f1-d1fa55f35e1a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.339306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a820c8-1003-4aa9-b1f1-d1fa55f35e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.356961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-18a820c8-1003-4aa9-b1f1-d1fa55f35e1a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:29.358504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-18a820c8-1003-4aa9-b1f1-d1fa55f35e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:29.402894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9e7900-65b7-466b-a7d7-899d7da12af7 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.437561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee54755-53a9-473e-bac8-3e49fa35745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.438972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee54755-53a9-473e-bac8-3e49fa35745b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.439555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee54755-53a9-473e-bac8-3e49fa35745b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.440077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee54755-53a9-473e-bac8-3e49fa35745b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.458980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 346/691] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:29.458980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a820c8-1003-4aa9-b1f1-d1fa55f35e1a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.460536 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee54755-53a9-473e-bac8-3e49fa35745b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:29.462408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee54755-53a9-473e-bac8-3e49fa35745b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-aee54755-53a9-473e-bac8-3e49fa35745b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:29.494979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:29.495931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:29.496826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:29.496826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:29.496826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:29.496826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:29.499368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 346/692] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:29.502084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee54755-53a9-473e-bac8-3e49fa35745b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.558639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.581381 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.584829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a820c8-1003-4aa9-b1f1-d1fa55f35e1a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.616045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee54755-53a9-473e-bac8-3e49fa35745b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.635396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf8e54-b5ed-4e0e-9ca5-8c5ce5ebca51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.636199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf8e54-b5ed-4e0e-9ca5-8c5ce5ebca51 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.636486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf8e54-b5ed-4e0e-9ca5-8c5ce5ebca51 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.636764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf8e54-b5ed-4e0e-9ca5-8c5ce5ebca51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.650099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf8e54-b5ed-4e0e-9ca5-8c5ce5ebca51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:29.651598 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf8e54-b5ed-4e0e-9ca5-8c5ce5ebca51 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:29.653716 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453060-6596-4c33-b222-81ac0fcb91a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.654734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453060-6596-4c33-b222-81ac0fcb91a6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.655253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453060-6596-4c33-b222-81ac0fcb91a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.655738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf453060-6596-4c33-b222-81ac0fcb91a6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.656586 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf453060-6596-4c33-b222-81ac0fcb91a6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:29.658316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf453060-6596-4c33-b222-81ac0fcb91a6 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-51cf8e54-b5ed-4e0e-9ca5-8c5ce5ebca51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:29.671114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:29.672819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:29.674375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:29.674375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:29.674375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:29.674375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:29.674375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 347/693] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:29.674375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf8e54-b5ed-4e0e-9ca5-8c5ce5ebca51 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-bf453060-6596-4c33-b222-81ac0fcb91a6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:29.680410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:29.681360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:29.682220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:29.689564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 347/694] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:29.690614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453060-6596-4c33-b222-81ac0fcb91a6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.794814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf453060-6596-4c33-b222-81ac0fcb91a6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.798062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf8e54-b5ed-4e0e-9ca5-8c5ce5ebca51 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.829906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250d9e-df4a-4dcb-93cc-ea9ddc25989d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.830914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250d9e-df4a-4dcb-93cc-ea9ddc25989d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.831981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250d9e-df4a-4dcb-93cc-ea9ddc25989d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.832477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc250d9e-df4a-4dcb-93cc-ea9ddc25989d None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.833430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc250d9e-df4a-4dcb-93cc-ea9ddc25989d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:29.834002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc250d9e-df4a-4dcb-93cc-ea9ddc25989d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:29.834607 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0cac0-1998-4113-b73d-948f8b3762b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:29.835320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cac0-1998-4113-b73d-948f8b3762b9 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:29.835603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cac0-1998-4113-b73d-948f8b3762b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:29.835884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0cac0-1998-4113-b73d-948f8b3762b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:29.836611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0cac0-1998-4113-b73d-948f8b3762b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:29.836922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0cac0-1998-4113-b73d-948f8b3762b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:29.837151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc250d9e-df4a-4dcb-93cc-ea9ddc25989d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:29.838563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0cac0-1998-4113-b73d-948f8b3762b9 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:29.839389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.848287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:29.852201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 348/695] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:29.853371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0cac0-1998-4113-b73d-948f8b3762b9 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.854246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 348/696] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:29.857526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250d9e-df4a-4dcb-93cc-ea9ddc25989d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:29.965401 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc250d9e-df4a-4dcb-93cc-ea9ddc25989d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:29.967136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0cac0-1998-4113-b73d-948f8b3762b9 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.000879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a3b17-2cea-4c53-9bce-7d5e4de947b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.001906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3b17-2cea-4c53-9bce-7d5e4de947b5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.002366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3b17-2cea-4c53-9bce-7d5e4de947b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.002785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a3b17-2cea-4c53-9bce-7d5e4de947b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.004710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db64473-3569-4c6e-a6ed-044ac93272b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.005534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db64473-3569-4c6e-a6ed-044ac93272b8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.005954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db64473-3569-4c6e-a6ed-044ac93272b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.006332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db64473-3569-4c6e-a6ed-044ac93272b8 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.007332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db64473-3569-4c6e-a6ed-044ac93272b8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:30.007753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db64473-3569-4c6e-a6ed-044ac93272b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.009288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db64473-3569-4c6e-a6ed-044ac93272b8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.012104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a3b17-2cea-4c53-9bce-7d5e4de947b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.013718 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a3b17-2cea-4c53-9bce-7d5e4de947b5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.018692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 349/697] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:30.018692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db64473-3569-4c6e-a6ed-044ac93272b8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-b59a3b17-2cea-4c53-9bce-7d5e4de947b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:30.033680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:30.035075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:30.036186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:30.036186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:30.036186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:30.036186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:30.036186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:30.036186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:30.036186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:30.036186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:30.036186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:30.036186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:30.038106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 349/698] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:30.039090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a3b17-2cea-4c53-9bce-7d5e4de947b5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.087452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.096528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.145855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db64473-3569-4c6e-a6ed-044ac93272b8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.147326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a3b17-2cea-4c53-9bce-7d5e4de947b5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.182667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7051a-965c-415e-ad55-f3747c0094da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.183959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d40f29-2d99-4936-a52b-2100abbc647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.184622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40f29-2d99-4936-a52b-2100abbc647c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.184905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40f29-2d99-4936-a52b-2100abbc647c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.185176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d40f29-2d99-4936-a52b-2100abbc647c None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.185877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d40f29-2d99-4936-a52b-2100abbc647c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:30.186184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d40f29-2d99-4936-a52b-2100abbc647c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.186746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7051a-965c-415e-ad55-f3747c0094da None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.187160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7051a-965c-415e-ad55-f3747c0094da None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.187535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a7051a-965c-415e-ad55-f3747c0094da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.187657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d40f29-2d99-4936-a52b-2100abbc647c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.194573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 350/699] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:30.195537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7051a-965c-415e-ad55-f3747c0094da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.195675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d40f29-2d99-4936-a52b-2100abbc647c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.197216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a7051a-965c-415e-ad55-f3747c0094da None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-25a7051a-965c-415e-ad55-f3747c0094da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:30.219837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:30.220926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:30.222529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:30.222529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:30.222529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:30.222529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:30.222529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:30.222529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:30.222529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:30.222529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:30.226986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 350/700] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:30.230236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7051a-965c-415e-ad55-f3747c0094da None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.351393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a7051a-965c-415e-ad55-f3747c0094da None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.385280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.393517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd823e5e-d56a-4f50-aa20-4fb4e06d9514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.394539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823e5e-d56a-4f50-aa20-4fb4e06d9514 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.394832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823e5e-d56a-4f50-aa20-4fb4e06d9514 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.395134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd823e5e-d56a-4f50-aa20-4fb4e06d9514 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.395942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd823e5e-d56a-4f50-aa20-4fb4e06d9514 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:30.396261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd823e5e-d56a-4f50-aa20-4fb4e06d9514 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.397752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd823e5e-d56a-4f50-aa20-4fb4e06d9514 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.420865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 351/701] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:30.426844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd823e5e-d56a-4f50-aa20-4fb4e06d9514 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.427591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d40f29-2d99-4936-a52b-2100abbc647c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.450210 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.474590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34882381-aff5-482f-af75-3957363792cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.475225 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34882381-aff5-482f-af75-3957363792cc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.475512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34882381-aff5-482f-af75-3957363792cc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.475791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34882381-aff5-482f-af75-3957363792cc None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.476645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34882381-aff5-482f-af75-3957363792cc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:30.476958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34882381-aff5-482f-af75-3957363792cc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.478917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34882381-aff5-482f-af75-3957363792cc None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.500850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 351/702] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:30.506625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34882381-aff5-482f-af75-3957363792cc None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:30.552144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd823e5e-d56a-4f50-aa20-4fb4e06d9514 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.597558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f4273-e883-49f7-8a42-a9fee6e11f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.598274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f4273-e883-49f7-8a42-a9fee6e11f56 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.598562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f4273-e883-49f7-8a42-a9fee6e11f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.598841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f4273-e883-49f7-8a42-a9fee6e11f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.599710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f4273-e883-49f7-8a42-a9fee6e11f56 None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=4bfb2a63f46a4a419da65805253ef7ac) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:30.600026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f4273-e883-49f7-8a42-a9fee6e11f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.601484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f4273-e883-49f7-8a42-a9fee6e11f56 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.615520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 352/703] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/role_assignments?user.id=4bfb2a63f46a4a419da65805253ef7ac&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:30.690097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34882381-aff5-482f-af75-3957363792cc None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:30.745280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026db50-e4dd-48b5-801f-c816863aabed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:30.746334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026db50-e4dd-48b5-801f-c816863aabed None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.746843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026db50-e4dd-48b5-801f-c816863aabed None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.747345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4026db50-e4dd-48b5-801f-c816863aabed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.811835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:30.837589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026db50-e4dd-48b5-801f-c816863aabed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:30.839375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4026db50-e4dd-48b5-801f-c816863aabed None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:30.917427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a25bb-ae34-4806-8606-1ebc5f02b070 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.917928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a25bb-ae34-4806-8606-1ebc5f02b070 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.918004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a25bb-ae34-4806-8606-1ebc5f02b070 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.920444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 353/704] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:30.925645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876de5b2-b034-4efb-988a-8ed4dc56dfb3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:30.925937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876de5b2-b034-4efb-988a-8ed4dc56dfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:30.926220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876de5b2-b034-4efb-988a-8ed4dc56dfb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:30.951599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-876de5b2-b034-4efb-988a-8ed4dc56dfb3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:30.952818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-876de5b2-b034-4efb-988a-8ed4dc56dfb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:30.955403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 352/705] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 21 04:05:30.963414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026db50-e4dd-48b5-801f-c816863aabed None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.008069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.038011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 354/706] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:31.039481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e128a-22d9-471c-8479-060578a4d0f4 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.039725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e128a-22d9-471c-8479-060578a4d0f4 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.040002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e128a-22d9-471c-8479-060578a4d0f4 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.041507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 355/707] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:31.048154 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561f67f-7fde-43b5-a62a-5ce61c60ca2a None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.048443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561f67f-7fde-43b5-a62a-5ce61c60ca2a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.048722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561f67f-7fde-43b5-a62a-5ce61c60ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.061550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.077776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a561f67f-7fde-43b5-a62a-5ce61c60ca2a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:31.079194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a561f67f-7fde-43b5-a62a-5ce61c60ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:31.091685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4026db50-e4dd-48b5-801f-c816863aabed None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.132952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8de2c3-5142-4a0c-b77f-753cc7606c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.134303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8de2c3-5142-4a0c-b77f-753cc7606c62 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.134812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8de2c3-5142-4a0c-b77f-753cc7606c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.135334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8de2c3-5142-4a0c-b77f-753cc7606c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.147204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8de2c3-5142-4a0c-b77f-753cc7606c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.149003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8de2c3-5142-4a0c-b77f-753cc7606c62 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-ae8de2c3-5142-4a0c-b77f-753cc7606c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:31.169902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:31.170845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:31.171798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:31.171798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:31.171798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:31.171798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:31.173531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 356/708] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:31.173829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 353/709] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:31.175141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561f67f-7fde-43b5-a62a-5ce61c60ca2a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.179385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8de2c3-5142-4a0c-b77f-753cc7606c62 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.302997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561f67f-7fde-43b5-a62a-5ce61c60ca2a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.306385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.330504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8de2c3-5142-4a0c-b77f-753cc7606c62 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.344864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be80f0-1a05-4c3f-8718-b16eea2e5316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.346071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be80f0-1a05-4c3f-8718-b16eea2e5316 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.346547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be80f0-1a05-4c3f-8718-b16eea2e5316 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.347631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be80f0-1a05-4c3f-8718-b16eea2e5316 None admin] PATH_INFO: `/v3/services/network` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.348501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be80f0-1a05-4c3f-8718-b16eea2e5316 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.350114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3be80f0-1a05-4c3f-8718-b16eea2e5316 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.363670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f3be80f0-1a05-4c3f-8718-b16eea2e5316 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:31.365567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:31.366550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:31.367397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:31.370992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 357/710] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/services/network => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:31.372149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be80f0-1a05-4c3f-8718-b16eea2e5316 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.373281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b73df-5826-42d7-8afe-c6ee2d5df0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.373945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b73df-5826-42d7-8afe-c6ee2d5df0fc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.374234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b73df-5826-42d7-8afe-c6ee2d5df0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.374515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b73df-5826-42d7-8afe-c6ee2d5df0fc None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.375426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b73df-5826-42d7-8afe-c6ee2d5df0fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:31.375748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b73df-5826-42d7-8afe-c6ee2d5df0fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.377358 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b73df-5826-42d7-8afe-c6ee2d5df0fc None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.397084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 354/711] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:31.398059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b73df-5826-42d7-8afe-c6ee2d5df0fc None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.485233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3be80f0-1a05-4c3f-8718-b16eea2e5316 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.523774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a6ed6-46da-45a0-aaaa-e8cc3a64a355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.525173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a6ed6-46da-45a0-aaaa-e8cc3a64a355 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.525836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a6ed6-46da-45a0-aaaa-e8cc3a64a355 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.526684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a6ed6-46da-45a0-aaaa-e8cc3a64a355 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.532707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b73df-5826-42d7-8afe-c6ee2d5df0fc None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.541418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a6ed6-46da-45a0-aaaa-e8cc3a64a355 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.543225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a6ed6-46da-45a0-aaaa-e8cc3a64a355 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-4b6a6ed6-46da-45a0-aaaa-e8cc3a64a355 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:31.566095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:31.567023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:31.567922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:31.567922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:31.567922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:31.567922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:31.568233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 358/712] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:31.569370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a6ed6-46da-45a0-aaaa-e8cc3a64a355 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.574866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7bed-25f7-4951-918f-bc0c74ff04d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.575809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7bed-25f7-4951-918f-bc0c74ff04d8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.576205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7bed-25f7-4951-918f-bc0c74ff04d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.576593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb7bed-25f7-4951-918f-bc0c74ff04d8 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.577471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7bed-25f7-4951-918f-bc0c74ff04d8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:31.577889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7bed-25f7-4951-918f-bc0c74ff04d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.580041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb7bed-25f7-4951-918f-bc0c74ff04d8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.587732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 355/713] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:31.589840 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7bed-25f7-4951-918f-bc0c74ff04d8 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.599432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.654637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.702242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a6ed6-46da-45a0-aaaa-e8cc3a64a355 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.721504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb7bed-25f7-4951-918f-bc0c74ff04d8 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.739500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22086-7e55-4dac-9085-057bc719416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.740439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22086-7e55-4dac-9085-057bc719416c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.740788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22086-7e55-4dac-9085-057bc719416c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.741132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e22086-7e55-4dac-9085-057bc719416c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.748484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22086-7e55-4dac-9085-057bc719416c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.750218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e22086-7e55-4dac-9085-057bc719416c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.762065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6da487-ed7b-416e-86eb-7db8137c310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.762712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6da487-ed7b-416e-86eb-7db8137c310c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.763038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6da487-ed7b-416e-86eb-7db8137c310c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.763361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6da487-ed7b-416e-86eb-7db8137c310c None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.764082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6da487-ed7b-416e-86eb-7db8137c310c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:31.764382 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6da487-ed7b-416e-86eb-7db8137c310c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.765736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6da487-ed7b-416e-86eb-7db8137c310c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-47e22086-7e55-4dac-9085-057bc719416c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:31.766349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:31.768123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:31.771113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:31.771113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:31.771113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:31.771113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:31.771113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:31.771113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:31.771113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:31.771113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:31.771113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 359/714] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:31.771113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22086-7e55-4dac-9085-057bc719416c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.785908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 356/715] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:31.786815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6da487-ed7b-416e-86eb-7db8137c310c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.871060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.891825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e22086-7e55-4dac-9085-057bc719416c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.903453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6da487-ed7b-416e-86eb-7db8137c310c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:31.917932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:31.928399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bd906-d749-4cd8-88a8-eb9d0ea019cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.929587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bd906-d749-4cd8-88a8-eb9d0ea019cb None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.930047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bd906-d749-4cd8-88a8-eb9d0ea019cb None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.930466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bd906-d749-4cd8-88a8-eb9d0ea019cb None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.931342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bd906-d749-4cd8-88a8-eb9d0ea019cb None admin] RBAC: Adding query filter params (type=network) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:31.931805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bd906-d749-4cd8-88a8-eb9d0ea019cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.933317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bd906-d749-4cd8-88a8-eb9d0ea019cb None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.939657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 360/716] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:31.941432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bd906-d749-4cd8-88a8-eb9d0ea019cb None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:31.942526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37a594-96a2-41b7-86b1-b616c86211a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:31.943250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37a594-96a2-41b7-86b1-b616c86211a3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:31.943540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37a594-96a2-41b7-86b1-b616c86211a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:31.943822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba37a594-96a2-41b7-86b1-b616c86211a3 None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:31.944631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37a594-96a2-41b7-86b1-b616c86211a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:31.944946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37a594-96a2-41b7-86b1-b616c86211a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:31.947158 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba37a594-96a2-41b7-86b1-b616c86211a3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:31.960542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 357/717] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:31.966710 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37a594-96a2-41b7-86b1-b616c86211a3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.054508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bd906-d749-4cd8-88a8-eb9d0ea019cb None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.080080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba37a594-96a2-41b7-86b1-b616c86211a3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.092700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60a4766-d815-424e-a50f-4930694e1e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.093639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4766-d815-424e-a50f-4930694e1e86 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.094082 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4766-d815-424e-a50f-4930694e1e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.094537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a4766-d815-424e-a50f-4930694e1e86 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.095419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a4766-d815-424e-a50f-4930694e1e86 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.097737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60a4766-d815-424e-a50f-4930694e1e86 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.120956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ec02-c227-4097-ab74-82bd7c617240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.121722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ec02-c227-4097-ab74-82bd7c617240 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.121941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ec02-c227-4097-ab74-82bd7c617240 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.122208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ec02-c227-4097-ab74-82bd7c617240 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.123448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ec02-c227-4097-ab74-82bd7c617240 None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=5a82fed4ff8845919b1da05f7e8d1d72) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:32.123770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ec02-c227-4097-ab74-82bd7c617240 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.124560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:32.125965 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ec02-c227-4097-ab74-82bd7c617240 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.138214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 361/719] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:05:31 2022] POST /identity/v3/users => generated 254 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:32.138425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 358/719] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:31 2022] GET /identity/v3/role_assignments?user.id=5a82fed4ff8845919b1da05f7e8d1d72&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:32.625332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696cd4a-8f76-47a2-a5f7-267a94d35982 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.625737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696cd4a-8f76-47a2-a5f7-267a94d35982 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.625916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696cd4a-8f76-47a2-a5f7-267a94d35982 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.627568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 359/720] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:32.632924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408dcf-52ab-4fd3-9ad8-a4465606d7fa None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.633219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408dcf-52ab-4fd3-9ad8-a4465606d7fa None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.633505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a408dcf-52ab-4fd3-9ad8-a4465606d7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.653618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-6a408dcf-52ab-4fd3-9ad8-a4465606d7fa None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:32.654836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6a408dcf-52ab-4fd3-9ad8-a4465606d7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:32.742717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 362/721] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:32.773702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696cd4a-8f76-47a2-a5f7-267a94d35982 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:32.830726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:32.929724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696cd4a-8f76-47a2-a5f7-267a94d35982 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:32.975256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8985e886-2f7b-4e9d-97b9-52722bb2f4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:32.975931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985e886-2f7b-4e9d-97b9-52722bb2f4d4 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:32.976220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985e886-2f7b-4e9d-97b9-52722bb2f4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:32.976502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8985e886-2f7b-4e9d-97b9-52722bb2f4d4 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:32.977244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985e886-2f7b-4e9d-97b9-52722bb2f4d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:32.978636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8985e886-2f7b-4e9d-97b9-52722bb2f4d4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:32.999790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 360/722] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:05:32 2022] POST /identity/v3/services => generated 251 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:33.129514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c775a5-a994-4bf0-975c-b76f3a1f1ea7 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.130199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c775a5-a994-4bf0-975c-b76f3a1f1ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.130199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c775a5-a994-4bf0-975c-b76f3a1f1ea7 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.131566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 363/723] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:33.137408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00981b-ebdd-494d-b689-c8e0a354e670 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.137683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00981b-ebdd-494d-b689-c8e0a354e670 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.137969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00981b-ebdd-494d-b689-c8e0a354e670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.161955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-ba00981b-ebdd-494d-b689-c8e0a354e670 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:33.163906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ba00981b-ebdd-494d-b689-c8e0a354e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:33.260405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 361/724] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 21 04:05:33.283645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c775a5-a994-4bf0-975c-b76f3a1f1ea7 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.400415 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c775a5-a994-4bf0-975c-b76f3a1f1ea7 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.446323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:33.451959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5b95a-e2e0-416c-b23c-51dff465a6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.452763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5b95a-e2e0-416c-b23c-51dff465a6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.459362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5b95a-e2e0-416c-b23c-51dff465a6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.459982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f5b95a-e2e0-416c-b23c-51dff465a6f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.475398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f5b95a-e2e0-416c-b23c-51dff465a6f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-54f5b95a-e2e0-416c-b23c-51dff465a6f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:33.483063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:33.484001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:33.485416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 364/725] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:33.492623 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00981b-ebdd-494d-b689-c8e0a354e670 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.549109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:33.646332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00981b-ebdd-494d-b689-c8e0a354e670 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.681817 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb974ac-2052-45be-ab76-71c5e249ac37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.682488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb974ac-2052-45be-ab76-71c5e249ac37 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.682762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb974ac-2052-45be-ab76-71c5e249ac37 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.683067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb974ac-2052-45be-ab76-71c5e249ac37 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.683814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb974ac-2052-45be-ab76-71c5e249ac37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:33.684123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb974ac-2052-45be-ab76-71c5e249ac37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:33.685529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb974ac-2052-45be-ab76-71c5e249ac37 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:33.695785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 362/726] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:33.701322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5b95a-e2e0-416c-b23c-51dff465a6f3 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:33.837180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f5b95a-e2e0-416c-b23c-51dff465a6f3 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:33.880481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cbbbe-9321-460e-99c2-8c20bd8df489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:33.881684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cbbbe-9321-460e-99c2-8c20bd8df489 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:33.882203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cbbbe-9321-460e-99c2-8c20bd8df489 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:33.882707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2cbbbe-9321-460e-99c2-8c20bd8df489 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:33.905108 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cbbbe-9321-460e-99c2-8c20bd8df489 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:33.906603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2cbbbe-9321-460e-99c2-8c20bd8df489 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-fb2cbbbe-9321-460e-99c2-8c20bd8df489 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:33.924294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:33.925290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:33.926783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:33.926783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:33.926783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:33.926783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:33.926783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 365/727] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:33.936069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb974ac-2052-45be-ab76-71c5e249ac37 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.039650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:34.055815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb974ac-2052-45be-ab76-71c5e249ac37 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.097102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9da9aa-f86d-49c9-87e9-e7a4f3f32a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.097990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da9aa-f86d-49c9-87e9-e7a4f3f32a42 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.098282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da9aa-f86d-49c9-87e9-e7a4f3f32a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.098566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9da9aa-f86d-49c9-87e9-e7a4f3f32a42 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.099394 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9da9aa-f86d-49c9-87e9-e7a4f3f32a42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:34.099709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9da9aa-f86d-49c9-87e9-e7a4f3f32a42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.101134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9da9aa-f86d-49c9-87e9-e7a4f3f32a42 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.115525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 363/728] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:34.124033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cbbbe-9321-460e-99c2-8c20bd8df489 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.207108 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:34.304750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2cbbbe-9321-460e-99c2-8c20bd8df489 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.355173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb080d-9bb1-431f-961b-7efc9fd4c017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.355976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb080d-9bb1-431f-961b-7efc9fd4c017 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.356260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb080d-9bb1-431f-961b-7efc9fd4c017 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.356539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb080d-9bb1-431f-961b-7efc9fd4c017 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.369000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb080d-9bb1-431f-961b-7efc9fd4c017 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.370450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb080d-9bb1-431f-961b-7efc9fd4c017 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-7acb080d-9bb1-431f-961b-7efc9fd4c017 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:34.384349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:34.385304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:34.386789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 366/729] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:34.391467 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9da9aa-f86d-49c9-87e9-e7a4f3f32a42 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.574211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0125c9-d6c7-4058-ad30-f4a9825264e8 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.574515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0125c9-d6c7-4058-ad30-f4a9825264e8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.574699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0125c9-d6c7-4058-ad30-f4a9825264e8 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.576344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 367/730] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:34.581566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8273-e2fc-459f-a154-201a974ed8ab None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.581874 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8273-e2fc-459f-a154-201a974ed8ab None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.582220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf8273-e2fc-459f-a154-201a974ed8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.582685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9da9aa-f86d-49c9-87e9-e7a4f3f32a42 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.600364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-7fbf8273-e2fc-459f-a154-201a974ed8ab None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:34.601655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7fbf8273-e2fc-459f-a154-201a974ed8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:34.635136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e42c8f-f8ce-4f7a-9474-abc25483afa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.635819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e42c8f-f8ce-4f7a-9474-abc25483afa4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.636105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e42c8f-f8ce-4f7a-9474-abc25483afa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.636379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e42c8f-f8ce-4f7a-9474-abc25483afa4 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.637797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e42c8f-f8ce-4f7a-9474-abc25483afa4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:34.637797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e42c8f-f8ce-4f7a-9474-abc25483afa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.638996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e42c8f-f8ce-4f7a-9474-abc25483afa4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.658060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 364/731] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:34.669452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e42c8f-f8ce-4f7a-9474-abc25483afa4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.675461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:34.688464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 368/732] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:34 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:34.717845 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf8273-e2fc-459f-a154-201a974ed8ab None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.760594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:34.829757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e42c8f-f8ce-4f7a-9474-abc25483afa4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.837362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf8273-e2fc-459f-a154-201a974ed8ab None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:34.876569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2c52d7-9529-4518-a95f-b1f374c41d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.877513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe3990a-6db5-4df7-b60c-2a3f7b2dede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:34.877887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c52d7-9529-4518-a95f-b1f374c41d87 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.878510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c52d7-9529-4518-a95f-b1f374c41d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.878715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3990a-6db5-4df7-b60c-2a3f7b2dede7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.879142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3990a-6db5-4df7-b60c-2a3f7b2dede7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.879285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2c52d7-9529-4518-a95f-b1f374c41d87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.879589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe3990a-6db5-4df7-b60c-2a3f7b2dede7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.890411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2c52d7-9529-4518-a95f-b1f374c41d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-4f2c52d7-9529-4518-a95f-b1f374c41d87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:34.898726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:34.899681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:34.900509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:34.904833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 369/733] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:34.906167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d24add-e2a1-4ae0-83a9-860faccfc8de None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:34.906460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d24add-e2a1-4ae0-83a9-860faccfc8de None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:34.906745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d24add-e2a1-4ae0-83a9-860faccfc8de None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:34.912715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 370/734] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:34.912715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d24add-e2a1-4ae0-83a9-860faccfc8de None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:34.973011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3990a-6db5-4df7-b60c-2a3f7b2dede7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:34.974616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe3990a-6db5-4df7-b60c-2a3f7b2dede7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:34.976493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.016253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.031639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d24add-e2a1-4ae0-83a9-860faccfc8de None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.078397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aba59e-1acd-42fc-b2fc-d1dfb14c413a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.079221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aba59e-1acd-42fc-b2fc-d1dfb14c413a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.079544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aba59e-1acd-42fc-b2fc-d1dfb14c413a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.079973 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aba59e-1acd-42fc-b2fc-d1dfb14c413a None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.080672 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aba59e-1acd-42fc-b2fc-d1dfb14c413a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:35.080981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aba59e-1acd-42fc-b2fc-d1dfb14c413a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.083613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aba59e-1acd-42fc-b2fc-d1dfb14c413a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.094677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 365/735] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 21 04:05:35.096347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65a808-ddff-4d3d-9e30-13a8c2af18a3 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.096899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65a808-ddff-4d3d-9e30-13a8c2af18a3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.097922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65a808-ddff-4d3d-9e30-13a8c2af18a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.100495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 371/736] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:35.101498 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aba59e-1acd-42fc-b2fc-d1dfb14c413a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.116564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-dc65a808-ddff-4d3d-9e30-13a8c2af18a3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:35.118262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-dc65a808-ddff-4d3d-9e30-13a8c2af18a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:35.200797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 366/737] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:35 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 21 04:05:35.201895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65a808-ddff-4d3d-9e30-13a8c2af18a3 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.225822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aba59e-1acd-42fc-b2fc-d1dfb14c413a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.243897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.264440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140063de-1c34-4ba0-861b-c743037c054f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.265227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140063de-1c34-4ba0-861b-c743037c054f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.265521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140063de-1c34-4ba0-861b-c743037c054f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.265777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140063de-1c34-4ba0-861b-c743037c054f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.277565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140063de-1c34-4ba0-861b-c743037c054f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.279058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140063de-1c34-4ba0-861b-c743037c054f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-140063de-1c34-4ba0-861b-c743037c054f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:35.297648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:35.298605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:35.299543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:35.299543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:35.299543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:35.299543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:35.299543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 372/738] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:35.300476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec19f-dd74-4e5d-9119-0d3fe6412a64 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.301187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec19f-dd74-4e5d-9119-0d3fe6412a64 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.301424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ec19f-dd74-4e5d-9119-0d3fe6412a64 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.302820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 373/739] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:35.307595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ec19f-dd74-4e5d-9119-0d3fe6412a64 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.317064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.327234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65a808-ddff-4d3d-9e30-13a8c2af18a3 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.366364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0274b1f-c44a-4cf4-8188-4da1d7ff54f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.367103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0274b1f-c44a-4cf4-8188-4da1d7ff54f6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.367690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0274b1f-c44a-4cf4-8188-4da1d7ff54f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.367690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0274b1f-c44a-4cf4-8188-4da1d7ff54f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.379348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0274b1f-c44a-4cf4-8188-4da1d7ff54f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.380700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0274b1f-c44a-4cf4-8188-4da1d7ff54f6 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-c0274b1f-c44a-4cf4-8188-4da1d7ff54f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:35.400202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:35.401141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:35.402042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:35.402042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:35.402042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:35.402042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:35.402042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 367/740] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:35.402328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0274b1f-c44a-4cf4-8188-4da1d7ff54f6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.423521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ec19f-dd74-4e5d-9119-0d3fe6412a64 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.457960 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78908b4-c7bd-46a7-868a-5e84a3f74d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.458625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78908b4-c7bd-46a7-868a-5e84a3f74d75 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.458908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78908b4-c7bd-46a7-868a-5e84a3f74d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.459212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78908b4-c7bd-46a7-868a-5e84a3f74d75 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.459931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78908b4-c7bd-46a7-868a-5e84a3f74d75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.461310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78908b4-c7bd-46a7-868a-5e84a3f74d75 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.479088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 374/741] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:05:35 2022] POST /identity/v3/services => generated 240 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:35.479088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe1f3-615d-427b-bc42-62441a6d4cbe None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.479088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe1f3-615d-427b-bc42-62441a6d4cbe None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.479088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39efe1f3-615d-427b-bc42-62441a6d4cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.501877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.511729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-39efe1f3-615d-427b-bc42-62441a6d4cbe None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:35.513061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-39efe1f3-615d-427b-bc42-62441a6d4cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:35.524077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0274b1f-c44a-4cf4-8188-4da1d7ff54f6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.572471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578715e-9ddf-4e34-84c3-58b2620e6b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.573593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578715e-9ddf-4e34-84c3-58b2620e6b83 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.574126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578715e-9ddf-4e34-84c3-58b2620e6b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.574630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6578715e-9ddf-4e34-84c3-58b2620e6b83 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.575656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578715e-9ddf-4e34-84c3-58b2620e6b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:35.576289 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578715e-9ddf-4e34-84c3-58b2620e6b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.578066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6578715e-9ddf-4e34-84c3-58b2620e6b83 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.591317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.593818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 368/742] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:35.595055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578715e-9ddf-4e34-84c3-58b2620e6b83 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.599375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 375/743] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:35.604735 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efe1f3-615d-427b-bc42-62441a6d4cbe None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.714684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6578715e-9ddf-4e34-84c3-58b2620e6b83 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.744384 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39efe1f3-615d-427b-bc42-62441a6d4cbe None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.757842 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fa92a-c39e-4b4d-8f65-5da801a04198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.758510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa92a-c39e-4b4d-8f65-5da801a04198 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.758791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa92a-c39e-4b4d-8f65-5da801a04198 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.759099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa92a-c39e-4b4d-8f65-5da801a04198 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.759824 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fa92a-c39e-4b4d-8f65-5da801a04198 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:35.760129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fa92a-c39e-4b4d-8f65-5da801a04198 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.761517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fa92a-c39e-4b4d-8f65-5da801a04198 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.770653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.774585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 369/744] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:35.775606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fa92a-c39e-4b4d-8f65-5da801a04198 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.780839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2604bc-c682-4612-8ffc-44aea2e8d730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.781640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2604bc-c682-4612-8ffc-44aea2e8d730 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.781925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2604bc-c682-4612-8ffc-44aea2e8d730 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.782205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2604bc-c682-4612-8ffc-44aea2e8d730 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.790062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2604bc-c682-4612-8ffc-44aea2e8d730 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.791566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2604bc-c682-4612-8ffc-44aea2e8d730 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-dd2604bc-c682-4612-8ffc-44aea2e8d730 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:35.805314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:35.806240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:35.807233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:35.807233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:35.807233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:35.807233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:35.807233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:35.807233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:35.807233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:35.807233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:35.807233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 376/745] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:35.811775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56358f-5bf3-4876-9201-75e8040d5499 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.812071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56358f-5bf3-4876-9201-75e8040d5499 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.812355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56358f-5bf3-4876-9201-75e8040d5499 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.813788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 377/746] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:35.815840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56358f-5bf3-4876-9201-75e8040d5499 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.879309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:35.886318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fa92a-c39e-4b4d-8f65-5da801a04198 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.921439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8cd7-ec7e-40d0-9e0a-87942bdb07ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.922247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8cd7-ec7e-40d0-9e0a-87942bdb07ab None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.922531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8cd7-ec7e-40d0-9e0a-87942bdb07ab None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.922817 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae8cd7-ec7e-40d0-9e0a-87942bdb07ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.926693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a56358f-5bf3-4876-9201-75e8040d5499 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:35.933383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae8cd7-ec7e-40d0-9e0a-87942bdb07ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-8fae8cd7-ec7e-40d0-9e0a-87942bdb07ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:35.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:35.942265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:35.943145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 370/747] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:35.943829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8cd7-ec7e-40d0-9e0a-87942bdb07ab None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:35.968841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0edc49-24ec-4d32-9733-1bcf09f6b6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:35.970034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0edc49-24ec-4d32-9733-1bcf09f6b6ae None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:35.970553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0edc49-24ec-4d32-9733-1bcf09f6b6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:35.970838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0edc49-24ec-4d32-9733-1bcf09f6b6ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:35.979743 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0edc49-24ec-4d32-9733-1bcf09f6b6ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:35.981228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0edc49-24ec-4d32-9733-1bcf09f6b6ae None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-6f0edc49-24ec-4d32-9733-1bcf09f6b6ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:35.996163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:35.997153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:35.998136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 378/748] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:36.003248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d6ecf-8478-4864-b0d9-4f14b77150af None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.003542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d6ecf-8478-4864-b0d9-4f14b77150af None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.003823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93d6ecf-8478-4864-b0d9-4f14b77150af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.009631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.022203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b93d6ecf-8478-4864-b0d9-4f14b77150af None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:36.023488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b93d6ecf-8478-4864-b0d9-4f14b77150af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:36.058651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae8cd7-ec7e-40d0-9e0a-87942bdb07ab None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.098132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288933bb-5f7d-42e4-87eb-d83321d2a821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.098858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288933bb-5f7d-42e4-87eb-d83321d2a821 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.099168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288933bb-5f7d-42e4-87eb-d83321d2a821 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.099434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288933bb-5f7d-42e4-87eb-d83321d2a821 None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.100219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288933bb-5f7d-42e4-87eb-d83321d2a821 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:36.100527 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288933bb-5f7d-42e4-87eb-d83321d2a821 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.101960 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288933bb-5f7d-42e4-87eb-d83321d2a821 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.103087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 379/749] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:36.104303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d6ecf-8478-4864-b0d9-4f14b77150af None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.118542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 371/750] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:36.119735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288933bb-5f7d-42e4-87eb-d83321d2a821 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.156833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.219460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93d6ecf-8478-4864-b0d9-4f14b77150af None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.242617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288933bb-5f7d-42e4-87eb-d83321d2a821 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.256533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6a63-db49-4913-b8ac-583cb9582beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.257258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6a63-db49-4913-b8ac-583cb9582beb None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.257755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6a63-db49-4913-b8ac-583cb9582beb None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.257755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded6a63-db49-4913-b8ac-583cb9582beb None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.258509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6a63-db49-4913-b8ac-583cb9582beb None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:36.258813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6a63-db49-4913-b8ac-583cb9582beb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.260289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ded6a63-db49-4913-b8ac-583cb9582beb None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.264855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.269756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 380/751] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:36.270598 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6a63-db49-4913-b8ac-583cb9582beb None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.286535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf35116-31ce-4bd7-8bd5-0997b71911c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.287234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf35116-31ce-4bd7-8bd5-0997b71911c5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.287522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf35116-31ce-4bd7-8bd5-0997b71911c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.287801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf35116-31ce-4bd7-8bd5-0997b71911c5 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.288649 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf35116-31ce-4bd7-8bd5-0997b71911c5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:36.288958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf35116-31ce-4bd7-8bd5-0997b71911c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.290408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf35116-31ce-4bd7-8bd5-0997b71911c5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.311057 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 372/752] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:36.311696 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf35116-31ce-4bd7-8bd5-0997b71911c5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.388085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded6a63-db49-4913-b8ac-583cb9582beb None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.398120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.413780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf35116-31ce-4bd7-8bd5-0997b71911c5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.425633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4462a-66f0-4a03-ac92-1afa38b14743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.426438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4462a-66f0-4a03-ac92-1afa38b14743 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.426719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4462a-66f0-4a03-ac92-1afa38b14743 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.427014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e4462a-66f0-4a03-ac92-1afa38b14743 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.427666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4462a-66f0-4a03-ac92-1afa38b14743 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.429040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e4462a-66f0-4a03-ac92-1afa38b14743 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-a6e4462a-66f0-4a03-ac92-1afa38b14743 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:36.441706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:36.442635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:36.443541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 381/753] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:36.444387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4462a-66f0-4a03-ac92-1afa38b14743 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.455174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dda4d-0f68-4b74-8268-e842e267d36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.456357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dda4d-0f68-4b74-8268-e842e267d36b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.456357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dda4d-0f68-4b74-8268-e842e267d36b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.456663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dda4d-0f68-4b74-8268-e842e267d36b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.457538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dda4d-0f68-4b74-8268-e842e267d36b None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=4bfb2a63f46a4a419da65805253ef7ac) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:36.457851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dda4d-0f68-4b74-8268-e842e267d36b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.459296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241dda4d-0f68-4b74-8268-e842e267d36b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.465380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 373/754] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/role_assignments?user.id=4bfb2a63f46a4a419da65805253ef7ac&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:36.466079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dda4d-0f68-4b74-8268-e842e267d36b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.515543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.600475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dda4d-0f68-4b74-8268-e842e267d36b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.601629 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e4462a-66f0-4a03-ac92-1afa38b14743 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.648908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f10d2-edb7-4916-8382-b873a186f3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.649707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f10d2-edb7-4916-8382-b873a186f3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.649991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f10d2-edb7-4916-8382-b873a186f3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.650269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f10d2-edb7-4916-8382-b873a186f3e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.654689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b25817-2156-4c17-beb2-97eadb6c5eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.655751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25817-2156-4c17-beb2-97eadb6c5eed None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.656265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25817-2156-4c17-beb2-97eadb6c5eed None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.656742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b25817-2156-4c17-beb2-97eadb6c5eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.661699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f10d2-edb7-4916-8382-b873a186f3e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.663222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f10d2-edb7-4916-8382-b873a186f3e7 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.672535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b25817-2156-4c17-beb2-97eadb6c5eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.674553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b25817-2156-4c17-beb2-97eadb6c5eed None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-c06f10d2-edb7-4916-8382-b873a186f3e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:36.681854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:36.682816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:36.683742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:36.683742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:36.683742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:36.683742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:36.683742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 382/755] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:36.684790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f10d2-edb7-4916-8382-b873a186f3e7 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-a3b25817-2156-4c17-beb2-97eadb6c5eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:36.704627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:36.705773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:36.707596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:36.707596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:36.707596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:36.707596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:36.709926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 374/756] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:36.710872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b25817-2156-4c17-beb2-97eadb6c5eed None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.717413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.797609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f10d2-edb7-4916-8382-b873a186f3e7 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.840658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.849548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b25817-2156-4c17-beb2-97eadb6c5eed None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:36.852324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea80a5-5fab-4fad-a1d5-9ebbddbdd937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.853474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea80a5-5fab-4fad-a1d5-9ebbddbdd937 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.853474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea80a5-5fab-4fad-a1d5-9ebbddbdd937 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.853670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea80a5-5fab-4fad-a1d5-9ebbddbdd937 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.854341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea80a5-5fab-4fad-a1d5-9ebbddbdd937 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:36.854655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea80a5-5fab-4fad-a1d5-9ebbddbdd937 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.856104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ea80a5-5fab-4fad-a1d5-9ebbddbdd937 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.866397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 383/757] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:36.867432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea80a5-5fab-4fad-a1d5-9ebbddbdd937 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.891823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a895e3-6067-4267-8692-2c6a81d3b7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:36.893238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a895e3-6067-4267-8692-2c6a81d3b7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:36.894513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a895e3-6067-4267-8692-2c6a81d3b7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:36.895104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a895e3-6067-4267-8692-2c6a81d3b7e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:36.896253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a895e3-6067-4267-8692-2c6a81d3b7e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:36.896711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a895e3-6067-4267-8692-2c6a81d3b7e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:36.898890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a895e3-6067-4267-8692-2c6a81d3b7e3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:36.915724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 375/758] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:36.917484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a895e3-6067-4267-8692-2c6a81d3b7e3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:36.973934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:36.995131 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea80a5-5fab-4fad-a1d5-9ebbddbdd937 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.040103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea45b0-4602-4f12-a4ce-d0cbdd6612de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.041260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea45b0-4602-4f12-a4ce-d0cbdd6612de None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.041717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea45b0-4602-4f12-a4ce-d0cbdd6612de None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.042261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea45b0-4602-4f12-a4ce-d0cbdd6612de None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.043458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea45b0-4602-4f12-a4ce-d0cbdd6612de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.044177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea45b0-4602-4f12-a4ce-d0cbdd6612de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.045728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea45b0-4602-4f12-a4ce-d0cbdd6612de None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.050440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a895e3-6067-4267-8692-2c6a81d3b7e3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.063667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 384/759] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.064768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea45b0-4602-4f12-a4ce-d0cbdd6612de None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.096719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae78fad-17d3-48f5-9ff4-9b180b924cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.098466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae78fad-17d3-48f5-9ff4-9b180b924cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.099226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae78fad-17d3-48f5-9ff4-9b180b924cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.099650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae78fad-17d3-48f5-9ff4-9b180b924cc6 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.100762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae78fad-17d3-48f5-9ff4-9b180b924cc6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.101624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae78fad-17d3-48f5-9ff4-9b180b924cc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.103695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae78fad-17d3-48f5-9ff4-9b180b924cc6 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.111453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 376/760] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 21 04:05:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.112547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae78fad-17d3-48f5-9ff4-9b180b924cc6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.137064 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.208299 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea45b0-4602-4f12-a4ce-d0cbdd6612de None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.250839 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae78fad-17d3-48f5-9ff4-9b180b924cc6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.259813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8a31e-884b-44d8-b8c4-9e20f0cb1148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.261751 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8a31e-884b-44d8-b8c4-9e20f0cb1148 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.262239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8a31e-884b-44d8-b8c4-9e20f0cb1148 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.263227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8a31e-884b-44d8-b8c4-9e20f0cb1148 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.274563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8a31e-884b-44d8-b8c4-9e20f0cb1148 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.277004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8a31e-884b-44d8-b8c4-9e20f0cb1148 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.290224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a38aa-5344-4f33-b524-c6fd04250e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.291149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a38aa-5344-4f33-b524-c6fd04250e11 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.291440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a38aa-5344-4f33-b524-c6fd04250e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.291719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a38aa-5344-4f33-b524-c6fd04250e11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.299385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a38aa-5344-4f33-b524-c6fd04250e11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-e5a8a31e-884b-44d8-b8c4-9e20f0cb1148 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:37.299807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:37.301309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:37.302249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:37.302249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:37.302249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:37.302249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:37.302249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:37.302249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:37.302249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:37.302249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:37.302249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:37.302249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:37.302786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a38aa-5344-4f33-b524-c6fd04250e11 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.305056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 385/761] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:37.306508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8a31e-884b-44d8-b8c4-9e20f0cb1148 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.319619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-bc6a38aa-5344-4f33-b524-c6fd04250e11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:37.320899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:37.321936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:37.323066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:37.323066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:37.323066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:37.323066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:37.323066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:37.323066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:37.323066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:37.323066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:37.325551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 377/762] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:37.326803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a38aa-5344-4f33-b524-c6fd04250e11 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.430931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8a31e-884b-44d8-b8c4-9e20f0cb1148 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.439665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.472599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a38aa-5344-4f33-b524-c6fd04250e11 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.473219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb95bb-87fc-46c3-8822-00393f9f8563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.474145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb95bb-87fc-46c3-8822-00393f9f8563 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.474529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb95bb-87fc-46c3-8822-00393f9f8563 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.475321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb95bb-87fc-46c3-8822-00393f9f8563 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.476986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb95bb-87fc-46c3-8822-00393f9f8563 None admin] RBAC: Adding query filter params (interface=public, service_id=a77c9ea2e4ae46ddb111a12aa6c794b3, region_id=RegionOne) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.476986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb95bb-87fc-46c3-8822-00393f9f8563 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.478320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb95bb-87fc-46c3-8822-00393f9f8563 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.491404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 386/763] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/endpoints?service_id=a77c9ea2e4ae46ddb111a12aa6c794b3&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.492478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb95bb-87fc-46c3-8822-00393f9f8563 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.516547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b20d6c-7b5a-45dc-b273-eec3a103197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.517470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b20d6c-7b5a-45dc-b273-eec3a103197a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.517888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b20d6c-7b5a-45dc-b273-eec3a103197a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.518308 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b20d6c-7b5a-45dc-b273-eec3a103197a None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.520621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b20d6c-7b5a-45dc-b273-eec3a103197a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.521086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b20d6c-7b5a-45dc-b273-eec3a103197a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.523192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b20d6c-7b5a-45dc-b273-eec3a103197a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.544741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 378/764] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.545706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b20d6c-7b5a-45dc-b273-eec3a103197a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.591592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.637868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb95bb-87fc-46c3-8822-00393f9f8563 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.666838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b20d6c-7b5a-45dc-b273-eec3a103197a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.684004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b2c7e-ad43-4db5-b165-b5c6b400b258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.684744 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b2c7e-ad43-4db5-b165-b5c6b400b258 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.685029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b2c7e-ad43-4db5-b165-b5c6b400b258 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.685305 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04b2c7e-ad43-4db5-b165-b5c6b400b258 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.686106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b2c7e-ad43-4db5-b165-b5c6b400b258 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:37.686418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b2c7e-ad43-4db5-b165-b5c6b400b258 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.687987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04b2c7e-ad43-4db5-b165-b5c6b400b258 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.703419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 387/765] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.704442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b2c7e-ad43-4db5-b165-b5c6b400b258 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.716736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a02ca-586d-4d9f-9b71-464536babacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.717768 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a02ca-586d-4d9f-9b71-464536babacf None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.718250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a02ca-586d-4d9f-9b71-464536babacf None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.718873 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0a02ca-586d-4d9f-9b71-464536babacf None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.719777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a02ca-586d-4d9f-9b71-464536babacf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.721923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0a02ca-586d-4d9f-9b71-464536babacf None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.724642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.730404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 379/766] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/services => generated 772 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:37.731588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a02ca-586d-4d9f-9b71-464536babacf None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:37.845805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04b2c7e-ad43-4db5-b165-b5c6b400b258 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.865955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0a02ca-586d-4d9f-9b71-464536babacf None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:37.881666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:37.887434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a22e-5fb5-44c7-b4a1-3c418d3e7c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.888105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a22e-5fb5-44c7-b4a1-3c418d3e7c92 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.888389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a22e-5fb5-44c7-b4a1-3c418d3e7c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.888672 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f380a22e-5fb5-44c7-b4a1-3c418d3e7c92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.906931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc66fb-85a0-47fd-95ff-d4bf66b736c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:37.907858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc66fb-85a0-47fd-95ff-d4bf66b736c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.908143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc66fb-85a0-47fd-95ff-d4bf66b736c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.908421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc66fb-85a0-47fd-95ff-d4bf66b736c1 None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/5a82fed4ff8845919b1da05f7e8d1d72/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.911009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc66fb-85a0-47fd-95ff-d4bf66b736c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=5a82fed4ff8845919b1da05f7e8d1d72, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.912469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc66fb-85a0-47fd-95ff-d4bf66b736c1 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:37.926642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 380/767] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:37 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/5a82fed4ff8845919b1da05f7e8d1d72/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:37.932335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fac40-e4e1-409a-9300-b6fd0d092bc6 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.932624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fac40-e4e1-409a-9300-b6fd0d092bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.932903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724fac40-e4e1-409a-9300-b6fd0d092bc6 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.935584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 381/768] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:37.941679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d8604-42c6-4325-a38a-a6dfcbfcba9b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:37.941973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d8604-42c6-4325-a38a-a6dfcbfcba9b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:37.942262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d8604-42c6-4325-a38a-a6dfcbfcba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:37.967931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-829d8604-42c6-4325-a38a-a6dfcbfcba9b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:37.970061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-829d8604-42c6-4325-a38a-a6dfcbfcba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:37.976952 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380a22e-5fb5-44c7-b4a1-3c418d3e7c92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:37.978457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f380a22e-5fb5-44c7-b4a1-3c418d3e7c92 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.079652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.102593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 382/769] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:05:38.135480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d8604-42c6-4325-a38a-a6dfcbfcba9b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.139054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 388/770] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:37 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:05:38.145853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a22e-5fb5-44c7-b4a1-3c418d3e7c92 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.178082 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.251224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f380a22e-5fb5-44c7-b4a1-3c418d3e7c92 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.253039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d8604-42c6-4325-a38a-a6dfcbfcba9b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.287206 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77947e8-c634-41f5-ae69-5b8147e9df51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.287999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77947e8-c634-41f5-ae69-5b8147e9df51 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.288281 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77947e8-c634-41f5-ae69-5b8147e9df51 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.288552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77947e8-c634-41f5-ae69-5b8147e9df51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.299362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77947e8-c634-41f5-ae69-5b8147e9df51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.301003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77947e8-c634-41f5-ae69-5b8147e9df51 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.324689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24210-6ce7-48a8-937a-49bf6323002f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.325468 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24210-6ce7-48a8-937a-49bf6323002f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.325751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24210-6ce7-48a8-937a-49bf6323002f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.326024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c24210-6ce7-48a8-937a-49bf6323002f None admin] PATH_INFO: `/v3/services/network` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.326679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c24210-6ce7-48a8-937a-49bf6323002f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.328087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c24210-6ce7-48a8-937a-49bf6323002f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f77947e8-c634-41f5-ae69-5b8147e9df51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:38.336628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:38.337737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:38.339638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:38.339638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:38.339638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:38.339638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:38.339638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 389/771] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:38.343603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77947e8-c634-41f5-ae69-5b8147e9df51 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f3c24210-6ce7-48a8-937a-49bf6323002f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:38.352767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:38.353757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:38.354629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:38.357416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 383/772] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/services/network => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:38.365097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24210-6ce7-48a8-937a-49bf6323002f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.447320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.463747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.470216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77947e8-c634-41f5-ae69-5b8147e9df51 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.513612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b084f-806a-4ca4-b2c7-175a6f58dbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.514279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b084f-806a-4ca4-b2c7-175a6f58dbea None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.514564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b084f-806a-4ca4-b2c7-175a6f58dbea None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.514840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923b084f-806a-4ca4-b2c7-175a6f58dbea None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.515607 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b084f-806a-4ca4-b2c7-175a6f58dbea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:38.515917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b084f-806a-4ca4-b2c7-175a6f58dbea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.517866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923b084f-806a-4ca4-b2c7-175a6f58dbea None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.531543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 390/773] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:38.536652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b084f-806a-4ca4-b2c7-175a6f58dbea None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.552872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c24210-6ce7-48a8-937a-49bf6323002f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.647400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923b084f-806a-4ca4-b2c7-175a6f58dbea None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.672257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4854e22-1ea1-472a-82fb-297f74178028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.672939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4854e22-1ea1-472a-82fb-297f74178028 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.673228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4854e22-1ea1-472a-82fb-297f74178028 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.673507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4854e22-1ea1-472a-82fb-297f74178028 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.674222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4854e22-1ea1-472a-82fb-297f74178028 None admin] RBAC: Adding query filter params (name=network) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:38.674534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4854e22-1ea1-472a-82fb-297f74178028 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.676088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4854e22-1ea1-472a-82fb-297f74178028 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.683529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc412e-46e3-4324-af04-813bfeea5f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.684742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc412e-46e3-4324-af04-813bfeea5f58 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.685032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc412e-46e3-4324-af04-813bfeea5f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.685317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fc412e-46e3-4324-af04-813bfeea5f58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.690195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 384/774] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/services?name=network => generated 124 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:38.697071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4854e22-1ea1-472a-82fb-297f74178028 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.699163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc412e-46e3-4324-af04-813bfeea5f58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.700641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fc412e-46e3-4324-af04-813bfeea5f58 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-52fc412e-46e3-4324-af04-813bfeea5f58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:38.734638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:38.735656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:38.736559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:38.736559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:38.736559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:38.736559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:38.736559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:38.736559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:38.736559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:38.736559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:38.742848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 391/775] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:38.745885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc412e-46e3-4324-af04-813bfeea5f58 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.751273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.854403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4854e22-1ea1-472a-82fb-297f74178028 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.866405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fc412e-46e3-4324-af04-813bfeea5f58 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:38.894715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:38.899638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7383e0-853e-4558-9197-1ff59a1bf81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.900351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7383e0-853e-4558-9197-1ff59a1bf81e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.900667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7383e0-853e-4558-9197-1ff59a1bf81e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.900918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7383e0-853e-4558-9197-1ff59a1bf81e None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.906977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7383e0-853e-4558-9197-1ff59a1bf81e None admin] RBAC: Adding query filter params (type=network) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:38.906977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7383e0-853e-4558-9197-1ff59a1bf81e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.906977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7383e0-853e-4558-9197-1ff59a1bf81e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.907293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a2547-1700-4fd6-9745-e48012382af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:38.907293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a2547-1700-4fd6-9745-e48012382af8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.907603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a2547-1700-4fd6-9745-e48012382af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.907831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a2547-1700-4fd6-9745-e48012382af8 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.908627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a2547-1700-4fd6-9745-e48012382af8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:38.908935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a2547-1700-4fd6-9745-e48012382af8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:38.910436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a2547-1700-4fd6-9745-e48012382af8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:38.913459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 385/776] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:38.914889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccefd1-e8b5-4131-b354-747ca8a7e5e0 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.915201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccefd1-e8b5-4131-b354-747ca8a7e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.915482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ccefd1-e8b5-4131-b354-747ca8a7e5e0 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.917068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 386/777] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:38.917770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccefd1-e8b5-4131-b354-747ca8a7e5e0 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:38.924218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 392/778] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:38.926111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1d20e-5ab8-439a-ac54-69265674b4a7 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:38.926401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1d20e-5ab8-439a-ac54-69265674b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:38.926683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1d20e-5ab8-439a-ac54-69265674b4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:38.944473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-41d1d20e-5ab8-439a-ac54-69265674b4a7 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:38.945736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-41d1d20e-5ab8-439a-ac54-69265674b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:39.009929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.021448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 393/779] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:39.022399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1d20e-5ab8-439a-ac54-69265674b4a7 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.045443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ccefd1-e8b5-4131-b354-747ca8a7e5e0 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.079159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3c224-1502-45bb-83b6-24f97cd2e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.079816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3c224-1502-45bb-83b6-24f97cd2e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.080443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3c224-1502-45bb-83b6-24f97cd2e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.080443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b3c224-1502-45bb-83b6-24f97cd2e4a5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.081660 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3c224-1502-45bb-83b6-24f97cd2e4a5 None admin] RBAC: Adding query filter params (interface=public, service_id=090206b1dc0b4f04b9398d29227b5ba9, region_id=RegionOne) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:39.081976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3c224-1502-45bb-83b6-24f97cd2e4a5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.083425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b3c224-1502-45bb-83b6-24f97cd2e4a5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.091425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 387/780] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 21 04:05:38 2022] GET /identity/v3/endpoints?service_id=090206b1dc0b4f04b9398d29227b5ba9&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:39.092292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3c224-1502-45bb-83b6-24f97cd2e4a5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.131017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1d20e-5ab8-439a-ac54-69265674b4a7 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.139436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.170447 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe45d6-de2e-454a-88cb-157f5d0c750c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.171416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe45d6-de2e-454a-88cb-157f5d0c750c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.171902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe45d6-de2e-454a-88cb-157f5d0c750c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.172328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abe45d6-de2e-454a-88cb-157f5d0c750c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.173417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe45d6-de2e-454a-88cb-157f5d0c750c None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=a9da3c101fd64bb496c7e5512edc9bf0) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:39.173877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe45d6-de2e-454a-88cb-157f5d0c750c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.175571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abe45d6-de2e-454a-88cb-157f5d0c750c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.182668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 394/781] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/role_assignments?user.id=a9da3c101fd64bb496c7e5512edc9bf0&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:39.183853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe45d6-de2e-454a-88cb-157f5d0c750c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.225360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b3c224-1502-45bb-83b6-24f97cd2e4a5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.256582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.304826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abe45d6-de2e-454a-88cb-157f5d0c750c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.317691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c15b2a-0ae7-4c26-80ee-216164b2b1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.318504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c15b2a-0ae7-4c26-80ee-216164b2b1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.318859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c15b2a-0ae7-4c26-80ee-216164b2b1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.319218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c15b2a-0ae7-4c26-80ee-216164b2b1d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.345031 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c15b2a-0ae7-4c26-80ee-216164b2b1d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:39.348280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed9285-c8c1-4b24-99ad-5c8aa980c3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.349119 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed9285-c8c1-4b24-99ad-5c8aa980c3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.349549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed9285-c8c1-4b24-99ad-5c8aa980c3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.349997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ed9285-c8c1-4b24-99ad-5c8aa980c3e8 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.350891 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed9285-c8c1-4b24-99ad-5c8aa980c3e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.352613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ed9285-c8c1-4b24-99ad-5c8aa980c3e8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.359048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 395/782] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-40c15b2a-0ae7-4c26-80ee-216164b2b1d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:39.361042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:39.361975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:39.363601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 388/783] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:39.372115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed9285-c8c1-4b24-99ad-5c8aa980c3e8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.526248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ed9285-c8c1-4b24-99ad-5c8aa980c3e8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.551311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.569110 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684222b-7f59-4105-837e-c1517a6fc9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.569780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684222b-7f59-4105-837e-c1517a6fc9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.570061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684222b-7f59-4105-837e-c1517a6fc9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.570336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d684222b-7f59-4105-837e-c1517a6fc9d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.571959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684222b-7f59-4105-837e-c1517a6fc9d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:39.571959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684222b-7f59-4105-837e-c1517a6fc9d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.572769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d684222b-7f59-4105-837e-c1517a6fc9d6 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.582924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 396/784] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:39.588674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c15b2a-0ae7-4c26-80ee-216164b2b1d4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.697879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c15b2a-0ae7-4c26-80ee-216164b2b1d4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.705178 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:39.746437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4749c-fed3-4b02-891f-adf6656dad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.747257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4749c-fed3-4b02-891f-adf6656dad0b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.747542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4749c-fed3-4b02-891f-adf6656dad0b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.747816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4749c-fed3-4b02-891f-adf6656dad0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.762591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4749c-fed3-4b02-891f-adf6656dad0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.764109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f4749c-fed3-4b02-891f-adf6656dad0b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-92f4749c-fed3-4b02-891f-adf6656dad0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:39.786231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:39.787155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:39.788052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:39.788052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:39.788052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:39.788052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:39.788052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 389/785] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:39.793245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684222b-7f59-4105-837e-c1517a6fc9d6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:39.912703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d684222b-7f59-4105-837e-c1517a6fc9d6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:39.959900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b72e8-e41f-47ca-9ff7-689a9eaed523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:39.960565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b72e8-e41f-47ca-9ff7-689a9eaed523 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:39.960849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b72e8-e41f-47ca-9ff7-689a9eaed523 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:39.961119 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b72e8-e41f-47ca-9ff7-689a9eaed523 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:39.961842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b72e8-e41f-47ca-9ff7-689a9eaed523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:39.962144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b72e8-e41f-47ca-9ff7-689a9eaed523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:39.963820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b72e8-e41f-47ca-9ff7-689a9eaed523 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:39.988895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 397/786] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:39.994482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4749c-fed3-4b02-891f-adf6656dad0b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.146947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4749c-fed3-4b02-891f-adf6656dad0b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.193524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0363-7d28-4e99-a2e9-e9786bc49c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.194322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0363-7d28-4e99-a2e9-e9786bc49c73 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.194612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0363-7d28-4e99-a2e9-e9786bc49c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.194893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0363-7d28-4e99-a2e9-e9786bc49c73 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.202985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac0363-7d28-4e99-a2e9-e9786bc49c73 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.204514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac0363-7d28-4e99-a2e9-e9786bc49c73 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-94ac0363-7d28-4e99-a2e9-e9786bc49c73 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:40.219949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:40.220922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:40.222475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 390/787] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:40.232030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b72e8-e41f-47ca-9ff7-689a9eaed523 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.316766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.389758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b72e8-e41f-47ca-9ff7-689a9eaed523 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.431747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e6396-c4a2-44bc-bbad-7a61feca5673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.432429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e6396-c4a2-44bc-bbad-7a61feca5673 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.432707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e6396-c4a2-44bc-bbad-7a61feca5673 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.432978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e6396-c4a2-44bc-bbad-7a61feca5673 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.433831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e6396-c4a2-44bc-bbad-7a61feca5673 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:40.434129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e6396-c4a2-44bc-bbad-7a61feca5673 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.435636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e6396-c4a2-44bc-bbad-7a61feca5673 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.462671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 398/788] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:40.468533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0363-7d28-4e99-a2e9-e9786bc49c73 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.481879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffa5f0-5299-42e9-b031-94701c71c738 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.482225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffa5f0-5299-42e9-b031-94701c71c738 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.482503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffa5f0-5299-42e9-b031-94701c71c738 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.484168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 399/789] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:40.493722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36119e-d4c0-487f-86e9-27e4e2f12cfe None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.494014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36119e-d4c0-487f-86e9-27e4e2f12cfe None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.494293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf36119e-d4c0-487f-86e9-27e4e2f12cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.505553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.513932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-cf36119e-d4c0-487f-86e9-27e4e2f12cfe None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:40.515372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-cf36119e-d4c0-487f-86e9-27e4e2f12cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:40.602205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 400/790] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:05:40.603887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4cc4b-cde1-4a66-a7c1-f7bca85e000d None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.604407 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4cc4b-cde1-4a66-a7c1-f7bca85e000d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.604901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b4cc4b-cde1-4a66-a7c1-f7bca85e000d None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.606592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 401/791] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:40.616913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62c089-8273-4e4e-8a93-0f0499ce5340 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.616913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62c089-8273-4e4e-8a93-0f0499ce5340 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.616913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc62c089-8273-4e4e-8a93-0f0499ce5340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.632842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-dc62c089-8273-4e4e-8a93-0f0499ce5340 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:40.634028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-dc62c089-8273-4e4e-8a93-0f0499ce5340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:40.634146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0363-7d28-4e99-a2e9-e9786bc49c73 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.666791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.678738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebab38b-a7e0-468c-822d-3bccc8a15877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.679864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebab38b-a7e0-468c-822d-3bccc8a15877 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.680362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebab38b-a7e0-468c-822d-3bccc8a15877 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.680833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebab38b-a7e0-468c-822d-3bccc8a15877 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.692530 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebab38b-a7e0-468c-822d-3bccc8a15877 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.694276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebab38b-a7e0-468c-822d-3bccc8a15877 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-5ebab38b-a7e0-468c-822d-3bccc8a15877 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:40.712229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:40.713464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:40.714369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:40.714369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:40.714369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:40.714369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:40.716865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 391/792] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:40.717935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebab38b-a7e0-468c-822d-3bccc8a15877 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.723286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 402/793] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:05:40.724254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62c089-8273-4e4e-8a93-0f0499ce5340 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.807272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:40.844130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc62c089-8273-4e4e-8a93-0f0499ce5340 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.846333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebab38b-a7e0-468c-822d-3bccc8a15877 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:40.884436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bab972-0325-4fbf-bd13-5de64a7ab5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.885116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bab972-0325-4fbf-bd13-5de64a7ab5eb None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.885407 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bab972-0325-4fbf-bd13-5de64a7ab5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.885690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bab972-0325-4fbf-bd13-5de64a7ab5eb None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.886428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bab972-0325-4fbf-bd13-5de64a7ab5eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:40.886742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bab972-0325-4fbf-bd13-5de64a7ab5eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.888169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bab972-0325-4fbf-bd13-5de64a7ab5eb None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.897694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda7aa-1005-43cc-b411-7d44beaf3668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:40.899150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda7aa-1005-43cc-b411-7d44beaf3668 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:40.899441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda7aa-1005-43cc-b411-7d44beaf3668 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:40.900061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdda7aa-1005-43cc-b411-7d44beaf3668 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:40.900746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdda7aa-1005-43cc-b411-7d44beaf3668 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:40.902093 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 403/794] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:40.902212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdda7aa-1005-43cc-b411-7d44beaf3668 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:40.903234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bab972-0325-4fbf-bd13-5de64a7ab5eb None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0fdda7aa-1005-43cc-b411-7d44beaf3668 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:40.919587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:40.920613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 21 04:05:40.921448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:40.923882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 392/795] 10.222.0.48 () {56 vars in 1129 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:40.923882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda7aa-1005-43cc-b411-7d44beaf3668 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:40.931946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.034137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bab972-0325-4fbf-bd13-5de64a7ab5eb None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.045279 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdda7aa-1005-43cc-b411-7d44beaf3668 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.079997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6140f-ef9c-4f40-9ffa-ce13ef15751d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.080715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4150727-60b5-4094-a88b-aaacc4d402f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.080939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6140f-ef9c-4f40-9ffa-ce13ef15751d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.081763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6140f-ef9c-4f40-9ffa-ce13ef15751d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.082355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4150727-60b5-4094-a88b-aaacc4d402f5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.082515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b6140f-ef9c-4f40-9ffa-ce13ef15751d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.082684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4150727-60b5-4094-a88b-aaacc4d402f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.082830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4150727-60b5-4094-a88b-aaacc4d402f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.084946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.091166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4150727-60b5-4094-a88b-aaacc4d402f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.092851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4150727-60b5-4094-a88b-aaacc4d402f5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.097576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b6140f-ef9c-4f40-9ffa-ce13ef15751d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-18b6140f-ef9c-4f40-9ffa-ce13ef15751d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:41.105852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:41.106801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:41.107698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-c4150727-60b5-4094-a88b-aaacc4d402f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:41.108671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:41.109599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:41.110501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:41.110501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:41.110501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:41.110501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:41.110501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:41.110501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:41.110501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:41.110501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:41.110501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 393/796] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:41.111107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4150727-60b5-4094-a88b-aaacc4d402f5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.117459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 404/797] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:41.117459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6140f-ef9c-4f40-9ffa-ce13ef15751d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.209020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.234774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b6140f-ef9c-4f40-9ffa-ce13ef15751d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.252521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4150727-60b5-4094-a88b-aaacc4d402f5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.282929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f8e56-14ca-409e-9812-d6629f273b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.284555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8e56-14ca-409e-9812-d6629f273b18 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.285390 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8e56-14ca-409e-9812-d6629f273b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.286087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4f8e56-14ca-409e-9812-d6629f273b18 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.287064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f8e56-14ca-409e-9812-d6629f273b18 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:41.287522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f8e56-14ca-409e-9812-d6629f273b18 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.289133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4f8e56-14ca-409e-9812-d6629f273b18 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.290202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2e13-84ca-4eee-8922-7c8c6207a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.291035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2e13-84ca-4eee-8922-7c8c6207a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.291461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2e13-84ca-4eee-8922-7c8c6207a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.291788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b2e13-84ca-4eee-8922-7c8c6207a6c4 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.292594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b2e13-84ca-4eee-8922-7c8c6207a6c4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:41.293212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b2e13-84ca-4eee-8922-7c8c6207a6c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.294500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b2e13-84ca-4eee-8922-7c8c6207a6c4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.300356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 394/798] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:41.301347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2e13-84ca-4eee-8922-7c8c6207a6c4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.307353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 405/799] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:41.308447 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f8e56-14ca-409e-9812-d6629f273b18 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.369939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.431239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b2e13-84ca-4eee-8922-7c8c6207a6c4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.443890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4f8e56-14ca-409e-9812-d6629f273b18 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.471456 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350816cb-8c5f-4374-a932-646a19f016ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.472531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350816cb-8c5f-4374-a932-646a19f016ef None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.473006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350816cb-8c5f-4374-a932-646a19f016ef None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.473574 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350816cb-8c5f-4374-a932-646a19f016ef None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.474555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350816cb-8c5f-4374-a932-646a19f016ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:41.475079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350816cb-8c5f-4374-a932-646a19f016ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.476831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350816cb-8c5f-4374-a932-646a19f016ef None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.481562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefa45c-cadd-4508-a5ff-6e58235d0b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.482313 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa45c-cadd-4508-a5ff-6e58235d0b0c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.482668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa45c-cadd-4508-a5ff-6e58235d0b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.483388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa45c-cadd-4508-a5ff-6e58235d0b0c None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.483849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefa45c-cadd-4508-a5ff-6e58235d0b0c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:41.484226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefa45c-cadd-4508-a5ff-6e58235d0b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.485674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefa45c-cadd-4508-a5ff-6e58235d0b0c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.491801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 406/800] 10.222.0.48 () {56 vars in 1124 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:41.492317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 395/801] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:41.492429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefa45c-cadd-4508-a5ff-6e58235d0b0c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.493577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350816cb-8c5f-4374-a932-646a19f016ef None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.501352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.599002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefa45c-cadd-4508-a5ff-6e58235d0b0c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.607679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350816cb-8c5f-4374-a932-646a19f016ef None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.630486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.635062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2468df2-b655-4ea6-bfe9-57afc4e0f246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.636155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2468df2-b655-4ea6-bfe9-57afc4e0f246 None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.636362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2468df2-b655-4ea6-bfe9-57afc4e0f246 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.636640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2468df2-b655-4ea6-bfe9-57afc4e0f246 None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/4bfb2a63f46a4a419da65805253ef7ac/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.638820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2468df2-b655-4ea6-bfe9-57afc4e0f246 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=4bfb2a63f46a4a419da65805253ef7ac, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.640410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2468df2-b655-4ea6-bfe9-57afc4e0f246 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.648185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d0cf9-ed01-4450-afcc-5354b48b92f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.649326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d0cf9-ed01-4450-afcc-5354b48b92f4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.649923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d0cf9-ed01-4450-afcc-5354b48b92f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.650408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d0cf9-ed01-4450-afcc-5354b48b92f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.656422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 407/802] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:41 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/4bfb2a63f46a4a419da65805253ef7ac/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:41.657543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2468df2-b655-4ea6-bfe9-57afc4e0f246 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.664930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d0cf9-ed01-4450-afcc-5354b48b92f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.666895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829d0cf9-ed01-4450-afcc-5354b48b92f4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-829d0cf9-ed01-4450-afcc-5354b48b92f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:41.687556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:41.688525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:41.689473 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:41.689473 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:41.689473 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:41.689473 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:41.692930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 396/803] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:41.698845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d0cf9-ed01-4450-afcc-5354b48b92f4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.744261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.786339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2468df2-b655-4ea6-bfe9-57afc4e0f246 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.824225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914f365-7c56-4869-ba9b-e4b57383e25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.824909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914f365-7c56-4869-ba9b-e4b57383e25f None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.825199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914f365-7c56-4869-ba9b-e4b57383e25f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.825481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914f365-7c56-4869-ba9b-e4b57383e25f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.825728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d0cf9-ed01-4450-afcc-5354b48b92f4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:41.826245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914f365-7c56-4869-ba9b-e4b57383e25f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.827745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914f365-7c56-4869-ba9b-e4b57383e25f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.853458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 408/804] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 21 04:05:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:41.854854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831fa4-4f86-4389-ae86-d123fa7d40dc None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.855178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831fa4-4f86-4389-ae86-d123fa7d40dc None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.855511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44831fa4-4f86-4389-ae86-d123fa7d40dc None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.857148 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 409/805] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:41.867292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c7d3-81ac-48ee-bee0-d31d903a0d96 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.867603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c7d3-81ac-48ee-bee0-d31d903a0d96 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.868537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29c7d3-81ac-48ee-bee0-d31d903a0d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.879958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70571e98-4b9f-45a3-95ba-5f0f225f09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:41.881015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70571e98-4b9f-45a3-95ba-5f0f225f09fe None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.881505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70571e98-4b9f-45a3-95ba-5f0f225f09fe None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.882034 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70571e98-4b9f-45a3-95ba-5f0f225f09fe None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.882879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70571e98-4b9f-45a3-95ba-5f0f225f09fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:41.883351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70571e98-4b9f-45a3-95ba-5f0f225f09fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:41.884936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70571e98-4b9f-45a3-95ba-5f0f225f09fe None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:41.889461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ea29c7d3-81ac-48ee-bee0-d31d903a0d96 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:41.891155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ea29c7d3-81ac-48ee-bee0-d31d903a0d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:41.900862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 397/806] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:41.906533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70571e98-4b9f-45a3-95ba-5f0f225f09fe None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:41.949073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:41.985439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 410/807] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:41.987463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf80d7-16be-4b40-975a-56f074a34030 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.987986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf80d7-16be-4b40-975a-56f074a34030 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.988451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf80d7-16be-4b40-975a-56f074a34030 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:41.990471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 411/808] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:41.995941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b4f81-a1ef-4785-bf8d-e8ec97dd3249 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:41.996695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b4f81-a1ef-4785-bf8d-e8ec97dd3249 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:41.997633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b4f81-a1ef-4785-bf8d-e8ec97dd3249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.018067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fa5b4f81-a1ef-4785-bf8d-e8ec97dd3249 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:42.020427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fa5b4f81-a1ef-4785-bf8d-e8ec97dd3249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:42.055903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70571e98-4b9f-45a3-95ba-5f0f225f09fe None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.087813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.102670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585a868-9695-4b93-b01e-025d177e0a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.104532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585a868-9695-4b93-b01e-025d177e0a14 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.105156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585a868-9695-4b93-b01e-025d177e0a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.106693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a585a868-9695-4b93-b01e-025d177e0a14 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.118274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 412/809] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:42.119493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b4f81-a1ef-4785-bf8d-e8ec97dd3249 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.124255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585a868-9695-4b93-b01e-025d177e0a14 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.125865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a585a868-9695-4b93-b01e-025d177e0a14 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-a585a868-9695-4b93-b01e-025d177e0a14 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:42.152961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:42.153993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:42.155110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 398/810] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 21 04:05:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:42.155715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585a868-9695-4b93-b01e-025d177e0a14 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.271905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b4f81-a1ef-4785-bf8d-e8ec97dd3249 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.276319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.291798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a585a868-9695-4b93-b01e-025d177e0a14 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.313343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341f707-a13b-4315-a822-b728195fce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.314237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341f707-a13b-4315-a822-b728195fce89 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.314519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341f707-a13b-4315-a822-b728195fce89 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.314799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341f707-a13b-4315-a822-b728195fce89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.326591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341f707-a13b-4315-a822-b728195fce89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:42.330079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a135f7-ef4c-4e0a-91cb-68b854b2bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.331228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a135f7-ef4c-4e0a-91cb-68b854b2bedc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.331728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a135f7-ef4c-4e0a-91cb-68b854b2bedc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.332274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a135f7-ef4c-4e0a-91cb-68b854b2bedc None admin] PATH_INFO: `/v3/services/network` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.333135 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a135f7-ef4c-4e0a-91cb-68b854b2bedc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.334774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a135f7-ef4c-4e0a-91cb-68b854b2bedc None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-d341f707-a13b-4315-a822-b728195fce89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:42.334886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:42.335912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 413/811] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:42.337459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341f707-a13b-4315-a822-b728195fce89 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-c8a135f7-ef4c-4e0a-91cb-68b854b2bedc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:42.352627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:42.353694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 21 04:05:42.354594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:42.357641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 399/812] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:42.358695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a135f7-ef4c-4e0a-91cb-68b854b2bedc None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.390243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.454432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341f707-a13b-4315-a822-b728195fce89 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.466136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a135f7-ef4c-4e0a-91cb-68b854b2bedc None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.493571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bce123-2534-40a5-85ec-ed0594d45cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.494622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce123-2534-40a5-85ec-ed0594d45cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.495082 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce123-2534-40a5-85ec-ed0594d45cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.495513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bce123-2534-40a5-85ec-ed0594d45cf4 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.496496 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bce123-2534-40a5-85ec-ed0594d45cf4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:42.497026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bce123-2534-40a5-85ec-ed0594d45cf4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.498749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bce123-2534-40a5-85ec-ed0594d45cf4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.503256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69e4ff-12f6-457f-86a7-93c1994c760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.504040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e4ff-12f6-457f-86a7-93c1994c760c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.504429 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e4ff-12f6-457f-86a7-93c1994c760c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.504810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69e4ff-12f6-457f-86a7-93c1994c760c None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.505741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69e4ff-12f6-457f-86a7-93c1994c760c None admin] RBAC: Adding query filter params (name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:42.506150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69e4ff-12f6-457f-86a7-93c1994c760c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.507712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69e4ff-12f6-457f-86a7-93c1994c760c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.516782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 400/813] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:42.517841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69e4ff-12f6-457f-86a7-93c1994c760c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.524351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 414/814] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:42.525508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bce123-2534-40a5-85ec-ed0594d45cf4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.540156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.629058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.632857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bce123-2534-40a5-85ec-ed0594d45cf4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.633406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69e4ff-12f6-457f-86a7-93c1994c760c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.669816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6c847-fb00-45ee-90a0-a74242f23eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.670326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9b343-b3d9-4561-bf5f-c0b71c90da54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.671075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c847-fb00-45ee-90a0-a74242f23eda None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.671193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9b343-b3d9-4561-bf5f-c0b71c90da54 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.671571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9b343-b3d9-4561-bf5f-c0b71c90da54 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.671752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c847-fb00-45ee-90a0-a74242f23eda None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.672035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba9b343-b3d9-4561-bf5f-c0b71c90da54 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.672330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c847-fb00-45ee-90a0-a74242f23eda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.672968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9b343-b3d9-4561-bf5f-c0b71c90da54 None admin] RBAC: Adding query filter params (name=network) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:42.673359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9b343-b3d9-4561-bf5f-c0b71c90da54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.675490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba9b343-b3d9-4561-bf5f-c0b71c90da54 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.685292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 401/815] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:42.685292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9b343-b3d9-4561-bf5f-c0b71c90da54 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.689299 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6c847-fb00-45ee-90a0-a74242f23eda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.691098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6c847-fb00-45ee-90a0-a74242f23eda None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-c1f6c847-fb00-45ee-90a0-a74242f23eda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:42.710067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:42.711063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:42.711988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:42.711988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:42.711988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:42.711988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:42.714373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 415/816] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:42.715376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6c847-fb00-45ee-90a0-a74242f23eda None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.774413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.798988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba9b343-b3d9-4561-bf5f-c0b71c90da54 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.821421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6c847-fb00-45ee-90a0-a74242f23eda None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.835102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11184f2-9a0a-466b-b4df-99be562811b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.835868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11184f2-9a0a-466b-b4df-99be562811b5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.836260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11184f2-9a0a-466b-b4df-99be562811b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.836613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11184f2-9a0a-466b-b4df-99be562811b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.860327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb85d2-4faf-40f7-b7e7-6a75fb46bd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:42.861275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb85d2-4faf-40f7-b7e7-6a75fb46bd97 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:42.861737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb85d2-4faf-40f7-b7e7-6a75fb46bd97 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:42.862244 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb85d2-4faf-40f7-b7e7-6a75fb46bd97 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:42.863161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb85d2-4faf-40f7-b7e7-6a75fb46bd97 None admin] RBAC: Adding query filter params (type=network) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:42.863648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb85d2-4faf-40f7-b7e7-6a75fb46bd97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.865265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb85d2-4faf-40f7-b7e7-6a75fb46bd97 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.875334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 416/817] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/services?type=network => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:42.876442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb85d2-4faf-40f7-b7e7-6a75fb46bd97 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:42.897149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:42.913432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11184f2-9a0a-466b-b4df-99be562811b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:42.915063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11184f2-9a0a-466b-b4df-99be562811b5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:42.986524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb85d2-4faf-40f7-b7e7-6a75fb46bd97 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:42.996738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.026587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 402/818] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:05:43.026587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11184f2-9a0a-466b-b4df-99be562811b5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.028692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770e590-81c4-4cee-b93f-f2af804a7adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.029610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e590-81c4-4cee-b93f-f2af804a7adf None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.030094 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e590-81c4-4cee-b93f-f2af804a7adf None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.030579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e590-81c4-4cee-b93f-f2af804a7adf None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.031547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770e590-81c4-4cee-b93f-f2af804a7adf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:43.032057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770e590-81c4-4cee-b93f-f2af804a7adf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.033641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770e590-81c4-4cee-b93f-f2af804a7adf None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.047014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 417/819] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:43.048221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770e590-81c4-4cee-b93f-f2af804a7adf None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.133201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.137359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11184f2-9a0a-466b-b4df-99be562811b5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.159587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770e590-81c4-4cee-b93f-f2af804a7adf None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.174163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f967e-4686-43d7-b938-be2825b9f488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.174854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f967e-4686-43d7-b938-be2825b9f488 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.175189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f967e-4686-43d7-b938-be2825b9f488 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.175471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f967e-4686-43d7-b938-be2825b9f488 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.176260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f967e-4686-43d7-b938-be2825b9f488 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.177596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f967e-4686-43d7-b938-be2825b9f488 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.200996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe9bcc-4c8f-48a8-83b3-172bc3302acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.211089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 403/820] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 21 04:05:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:43.211089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f967e-4686-43d7-b938-be2825b9f488 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.214410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe9bcc-4c8f-48a8-83b3-172bc3302acb None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.214911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe9bcc-4c8f-48a8-83b3-172bc3302acb None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.215442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe9bcc-4c8f-48a8-83b3-172bc3302acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.246281 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe9bcc-4c8f-48a8-83b3-172bc3302acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.248159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe9bcc-4c8f-48a8-83b3-172bc3302acb None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.250847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-3ebe9bcc-4c8f-48a8-83b3-172bc3302acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:43.286982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:43.288005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:43.288980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:43.288980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:43.288980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:43.288980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:43.291366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 418/821] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:43.296937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe9bcc-4c8f-48a8-83b3-172bc3302acb None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.344793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f967e-4686-43d7-b938-be2825b9f488 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.389703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f33039-f30b-4baa-bfb0-754d577335e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.390543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f33039-f30b-4baa-bfb0-754d577335e0 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.390829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f33039-f30b-4baa-bfb0-754d577335e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.391136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f33039-f30b-4baa-bfb0-754d577335e0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.400592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f33039-f30b-4baa-bfb0-754d577335e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.406991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f33039-f30b-4baa-bfb0-754d577335e0 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-84f33039-f30b-4baa-bfb0-754d577335e0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:43.444835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:43.445850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:43.446784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 404/822] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:43.452595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f33039-f30b-4baa-bfb0-754d577335e0 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.508726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe9bcc-4c8f-48a8-83b3-172bc3302acb None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.552700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.564693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76093b0c-de2e-4cc8-a1e5-db87e8a191d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.566352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76093b0c-de2e-4cc8-a1e5-db87e8a191d5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.567299 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76093b0c-de2e-4cc8-a1e5-db87e8a191d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.567934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76093b0c-de2e-4cc8-a1e5-db87e8a191d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.568997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76093b0c-de2e-4cc8-a1e5-db87e8a191d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:43.569766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76093b0c-de2e-4cc8-a1e5-db87e8a191d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.572211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76093b0c-de2e-4cc8-a1e5-db87e8a191d5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.585885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.589740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 419/823] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:43.595512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76093b0c-de2e-4cc8-a1e5-db87e8a191d5 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.600414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f33039-f30b-4baa-bfb0-754d577335e0 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.647433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be1bd-4c8e-4a75-9762-df3db0f71647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.648688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be1bd-4c8e-4a75-9762-df3db0f71647 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.649182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be1bd-4c8e-4a75-9762-df3db0f71647 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.649732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221be1bd-4c8e-4a75-9762-df3db0f71647 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.650860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221be1bd-4c8e-4a75-9762-df3db0f71647 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:43.651510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221be1bd-4c8e-4a75-9762-df3db0f71647 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.653316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221be1bd-4c8e-4a75-9762-df3db0f71647 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.679581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 405/824] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:43.682984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be1bd-4c8e-4a75-9762-df3db0f71647 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.707640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76093b0c-de2e-4cc8-a1e5-db87e8a191d5 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.745288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee477740-91fa-4b3d-b046-84d2b6f035ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.746090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee477740-91fa-4b3d-b046-84d2b6f035ff None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.746373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee477740-91fa-4b3d-b046-84d2b6f035ff None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.746645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee477740-91fa-4b3d-b046-84d2b6f035ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.754821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee477740-91fa-4b3d-b046-84d2b6f035ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.756547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee477740-91fa-4b3d-b046-84d2b6f035ff None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-ee477740-91fa-4b3d-b046-84d2b6f035ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:43.772690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:43.773684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:43.774612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:43.774612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:43.774612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:43.774612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:43.774612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:43.774612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:43.774612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:43.774612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:43.774612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 420/825] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:43.780935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee477740-91fa-4b3d-b046-84d2b6f035ff None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.804730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221be1bd-4c8e-4a75-9762-df3db0f71647 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.834026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.847326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb36c09-623f-4bae-b785-16d1bc9b283e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.848521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb36c09-623f-4bae-b785-16d1bc9b283e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.849156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb36c09-623f-4bae-b785-16d1bc9b283e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.849782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb36c09-623f-4bae-b785-16d1bc9b283e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.861658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb36c09-623f-4bae-b785-16d1bc9b283e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.863848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb36c09-623f-4bae-b785-16d1bc9b283e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.874380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-7eb36c09-623f-4bae-b785-16d1bc9b283e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:43.885141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:43.886043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:43.886935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:43.886935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:43.886935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:43.886935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:43.893254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 406/826] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:43.893254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01fd6-9d42-485e-80a4-5093c51b8ea4 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.893254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01fd6-9d42-485e-80a4-5093c51b8ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.893254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01fd6-9d42-485e-80a4-5093c51b8ea4 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.894251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee477740-91fa-4b3d-b046-84d2b6f035ff None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:43.894333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 407/827] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:43.898450 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01fd6-9d42-485e-80a4-5093c51b8ea4 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:43.928749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b3801-ac08-4d97-aa2f-6b9800911cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:43.929410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b3801-ac08-4d97-aa2f-6b9800911cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.929698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b3801-ac08-4d97-aa2f-6b9800911cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.929980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b3801-ac08-4d97-aa2f-6b9800911cd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.930766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b3801-ac08-4d97-aa2f-6b9800911cd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:43.931109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b3801-ac08-4d97-aa2f-6b9800911cd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:43.932563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b3801-ac08-4d97-aa2f-6b9800911cd2 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:43.946062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 421/828] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:43.948810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ce12e-a1c9-4407-ad66-d14627222816 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:43.949927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ce12e-a1c9-4407-ad66-d14627222816 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:43.950723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ce12e-a1c9-4407-ad66-d14627222816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:43.970741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a48ce12e-a1c9-4407-ad66-d14627222816 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:43.972060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a48ce12e-a1c9-4407-ad66-d14627222816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:44.011809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01fd6-9d42-485e-80a4-5093c51b8ea4 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.038979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 422/829] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:44.039915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ce12e-a1c9-4407-ad66-d14627222816 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.053032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ad9b5-454f-485a-b57d-322e44d64717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.053958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ad9b5-454f-485a-b57d-322e44d64717 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.054232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ad9b5-454f-485a-b57d-322e44d64717 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.054518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ad9b5-454f-485a-b57d-322e44d64717 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.055283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ad9b5-454f-485a-b57d-322e44d64717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:44.055593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ad9b5-454f-485a-b57d-322e44d64717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.056968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ad9b5-454f-485a-b57d-322e44d64717 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.069472 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 408/830] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:44.070867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8e52-66f4-4998-900b-d36a0b7e99ac None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.071195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8e52-66f4-4998-900b-d36a0b7e99ac None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.071475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb8e52-66f4-4998-900b-d36a0b7e99ac None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.072701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 409/831] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:44.073389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb8e52-66f4-4998-900b-d36a0b7e99ac None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.090511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.135966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.158486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ce12e-a1c9-4407-ad66-d14627222816 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.179262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb8e52-66f4-4998-900b-d36a0b7e99ac None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.193731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7d79d-8e1c-4588-80ad-5017b461717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.194391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7d79d-8e1c-4588-80ad-5017b461717b None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.194676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7d79d-8e1c-4588-80ad-5017b461717b None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.194969 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7d79d-8e1c-4588-80ad-5017b461717b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.195807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7d79d-8e1c-4588-80ad-5017b461717b None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=5a82fed4ff8845919b1da05f7e8d1d72) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:44.196122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7d79d-8e1c-4588-80ad-5017b461717b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.197569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b7d79d-8e1c-4588-80ad-5017b461717b None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.203396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 423/832] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/role_assignments?user.id=5a82fed4ff8845919b1da05f7e8d1d72&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:44.204184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7d79d-8e1c-4588-80ad-5017b461717b None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.225751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f3db3-54a8-4f0d-bad8-f8f27771cd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.226849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3db3-54a8-4f0d-bad8-f8f27771cd02 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.227187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3db3-54a8-4f0d-bad8-f8f27771cd02 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.227466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f3db3-54a8-4f0d-bad8-f8f27771cd02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.245253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f3db3-54a8-4f0d-bad8-f8f27771cd02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-9c4f3db3-54a8-4f0d-bad8-f8f27771cd02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:44.255367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:44.256379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:44.257223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 410/833] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:44.260221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ec776-3d3d-4f92-96c2-49775574ec5e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.260582 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ec776-3d3d-4f92-96c2-49775574ec5e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.260929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ec776-3d3d-4f92-96c2-49775574ec5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.279033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1a9ec776-3d3d-4f92-96c2-49775574ec5e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:44.280253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1a9ec776-3d3d-4f92-96c2-49775574ec5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:44.321198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b7d79d-8e1c-4588-80ad-5017b461717b None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.323073 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.357680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 411/834] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:44 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:44.358212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ec776-3d3d-4f92-96c2-49775574ec5e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.365636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f2493-c150-4e5d-9814-efbd31fbeb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.366433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2493-c150-4e5d-9814-efbd31fbeb5f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.366717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2493-c150-4e5d-9814-efbd31fbeb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.367018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f2493-c150-4e5d-9814-efbd31fbeb5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.373992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f2493-c150-4e5d-9814-efbd31fbeb5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.375479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f2493-c150-4e5d-9814-efbd31fbeb5f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f52f2493-c150-4e5d-9814-efbd31fbeb5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:44.391545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:44.392663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:44.394228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:44.394228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:44.394228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:44.394228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:44.394228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:44.394228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:44.394228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:44.394228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:44.394669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 424/835] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:44.395369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f2493-c150-4e5d-9814-efbd31fbeb5f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.422812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.478428 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ec776-3d3d-4f92-96c2-49775574ec5e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.505346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f2493-c150-4e5d-9814-efbd31fbeb5f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.542821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b292bb-dbcd-499b-b9ae-ab0ab93624cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.543664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b292bb-dbcd-499b-b9ae-ab0ab93624cc None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.543944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b292bb-dbcd-499b-b9ae-ab0ab93624cc None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.544215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b292bb-dbcd-499b-b9ae-ab0ab93624cc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.544875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b292bb-dbcd-499b-b9ae-ab0ab93624cc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.546314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b292bb-dbcd-499b-b9ae-ab0ab93624cc None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-a2b292bb-dbcd-499b-b9ae-ab0ab93624cc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:44.559327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:44.560471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:44.561857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 425/836] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:44.562671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b292bb-dbcd-499b-b9ae-ab0ab93624cc None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.596313 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.640030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f7dbf-d59d-498a-9ce8-e69829f5e272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.640699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7dbf-d59d-498a-9ce8-e69829f5e272 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.640988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7dbf-d59d-498a-9ce8-e69829f5e272 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.641268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f7dbf-d59d-498a-9ce8-e69829f5e272 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.642012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f7dbf-d59d-498a-9ce8-e69829f5e272 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:44.642324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f7dbf-d59d-498a-9ce8-e69829f5e272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.643858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9f7dbf-d59d-498a-9ce8-e69829f5e272 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.656939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 412/837] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:44.656939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f7dbf-d59d-498a-9ce8-e69829f5e272 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.679696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b292bb-dbcd-499b-b9ae-ab0ab93624cc None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.716420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88451ebd-8e09-45a2-b392-bd41c86446c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.717474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88451ebd-8e09-45a2-b392-bd41c86446c4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.717769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88451ebd-8e09-45a2-b392-bd41c86446c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.718291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88451ebd-8e09-45a2-b392-bd41c86446c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.718946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88451ebd-8e09-45a2-b392-bd41c86446c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:44.719286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88451ebd-8e09-45a2-b392-bd41c86446c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.720736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88451ebd-8e09-45a2-b392-bd41c86446c4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.733537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 426/838] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:44.734363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88451ebd-8e09-45a2-b392-bd41c86446c4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.765980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f7dbf-d59d-498a-9ce8-e69829f5e272 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.781469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.804554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841176f-9098-4296-ad8f-30221d09cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.805212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841176f-9098-4296-ad8f-30221d09cb96 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.805494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841176f-9098-4296-ad8f-30221d09cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.805769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6841176f-9098-4296-ad8f-30221d09cb96 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.806466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841176f-9098-4296-ad8f-30221d09cb96 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:44.806771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841176f-9098-4296-ad8f-30221d09cb96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.808173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6841176f-9098-4296-ad8f-30221d09cb96 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.818299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 413/839] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:44.818299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841176f-9098-4296-ad8f-30221d09cb96 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.826564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:44.843443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88451ebd-8e09-45a2-b392-bd41c86446c4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.880456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53795632-747f-419a-84d3-7fc9fbd1608d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.881252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53795632-747f-419a-84d3-7fc9fbd1608d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.881533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53795632-747f-419a-84d3-7fc9fbd1608d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.881805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53795632-747f-419a-84d3-7fc9fbd1608d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.891833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53795632-747f-419a-84d3-7fc9fbd1608d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.893275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53795632-747f-419a-84d3-7fc9fbd1608d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-53795632-747f-419a-84d3-7fc9fbd1608d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:44.914019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:44.915103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:44.916196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:44.916196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:44.916196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:44.916196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:44.918148 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 427/840] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:44.918936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53795632-747f-419a-84d3-7fc9fbd1608d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:44.928616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6841176f-9098-4296-ad8f-30221d09cb96 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:44.967604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb0ec0-9b21-4ab8-b359-1269a0a6fd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:44.969001 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb0ec0-9b21-4ab8-b359-1269a0a6fd1c None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:44.969292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb0ec0-9b21-4ab8-b359-1269a0a6fd1c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:44.969642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb0ec0-9b21-4ab8-b359-1269a0a6fd1c None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/a9da3c101fd64bb496c7e5512edc9bf0/roles/a1c2e9dff7da4c458034685fb77fed4b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:44.984672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb0ec0-9b21-4ab8-b359-1269a0a6fd1c None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=a9da3c101fd64bb496c7e5512edc9bf0, role_id=a1c2e9dff7da4c458034685fb77fed4b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:44.986046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb0ec0-9b21-4ab8-b359-1269a0a6fd1c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:44.998781 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 414/841] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:44 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/a9da3c101fd64bb496c7e5512edc9bf0/roles/a1c2e9dff7da4c458034685fb77fed4b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:05:44.999999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb0ec0-9b21-4ab8-b359-1269a0a6fd1c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.031066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.050601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53795632-747f-419a-84d3-7fc9fbd1608d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.092016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be7106-c984-42fb-add8-43c085f7d2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.093122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be7106-c984-42fb-add8-43c085f7d2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.093654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be7106-c984-42fb-add8-43c085f7d2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.094131 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be7106-c984-42fb-add8-43c085f7d2e2 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.095092 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be7106-c984-42fb-add8-43c085f7d2e2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:45.095611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be7106-c984-42fb-add8-43c085f7d2e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.097916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be7106-c984-42fb-add8-43c085f7d2e2 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.103942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 428/842] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:45.126835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb0ec0-9b21-4ab8-b359-1269a0a6fd1c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.169368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ddbac-a7d0-458d-b3e2-73119e7c5103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.170141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ddbac-a7d0-458d-b3e2-73119e7c5103 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.170431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ddbac-a7d0-458d-b3e2-73119e7c5103 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.170752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ddbac-a7d0-458d-b3e2-73119e7c5103 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.171540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ddbac-a7d0-458d-b3e2-73119e7c5103 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:45.171845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ddbac-a7d0-458d-b3e2-73119e7c5103 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.173271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ddbac-a7d0-458d-b3e2-73119e7c5103 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.190885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 415/843] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:45.193571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be7106-c984-42fb-add8-43c085f7d2e2 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.196420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.318881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be7106-c984-42fb-add8-43c085f7d2e2 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.355679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135846a5-3f07-4fda-96c1-baaee1fea9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.356485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135846a5-3f07-4fda-96c1-baaee1fea9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.356758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135846a5-3f07-4fda-96c1-baaee1fea9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.357034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135846a5-3f07-4fda-96c1-baaee1fea9c6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.365985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135846a5-3f07-4fda-96c1-baaee1fea9c6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.367495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135846a5-3f07-4fda-96c1-baaee1fea9c6 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-135846a5-3f07-4fda-96c1-baaee1fea9c6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:45.383787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:45.384808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:45.386023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 429/844] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:45.393094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ddbac-a7d0-458d-b3e2-73119e7c5103 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.491600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.507310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ddbac-a7d0-458d-b3e2-73119e7c5103 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.543925 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fea355-675f-418f-833f-7dffd12613f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.544596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fea355-675f-418f-833f-7dffd12613f9 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.544882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fea355-675f-418f-833f-7dffd12613f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.545159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fea355-675f-418f-833f-7dffd12613f9 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.545997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fea355-675f-418f-833f-7dffd12613f9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:45.546306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fea355-675f-418f-833f-7dffd12613f9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.547773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fea355-675f-418f-833f-7dffd12613f9 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.567449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 416/845] 10.222.0.48 () {56 vars in 1135 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:45.576125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135846a5-3f07-4fda-96c1-baaee1fea9c6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:45.643917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.684060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135846a5-3f07-4fda-96c1-baaee1fea9c6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:45.719136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cda189-3e44-4808-b039-b361e41b4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:45.719788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda189-3e44-4808-b039-b361e41b4baf None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:45.720067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda189-3e44-4808-b039-b361e41b4baf None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:45.720344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cda189-3e44-4808-b039-b361e41b4baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:45.790794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cda189-3e44-4808-b039-b361e41b4baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:45.792344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cda189-3e44-4808-b039-b361e41b4baf None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:45.855651 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:45.897055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 430/846] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:05:45.902848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fea355-675f-418f-833f-7dffd12613f9 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.007944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fea355-675f-418f-833f-7dffd12613f9 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.042812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ccc69e-1834-4417-a7b5-b0629e41b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.043627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccc69e-1834-4417-a7b5-b0629e41b908 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.043905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccc69e-1834-4417-a7b5-b0629e41b908 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.044178 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ccc69e-1834-4417-a7b5-b0629e41b908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.054430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccc69e-1834-4417-a7b5-b0629e41b908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.055907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ccc69e-1834-4417-a7b5-b0629e41b908 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.058391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-57ccc69e-1834-4417-a7b5-b0629e41b908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:46.076120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:46.077039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:46.077943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:46.077943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:46.077943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:46.077943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:46.085254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 417/847] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:46.086859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cda189-3e44-4808-b039-b361e41b4baf None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.193346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cda189-3e44-4808-b039-b361e41b4baf None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.340241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e13c6b-27d3-4652-bcf2-4d1e183b9eba None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.340570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e13c6b-27d3-4652-bcf2-4d1e183b9eba None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.340913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e13c6b-27d3-4652-bcf2-4d1e183b9eba None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.342400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 418/848] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:46.348106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699754cb-ee69-4eb4-a232-6d8070dd28f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.348524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d729b-e581-4557-8944-1c5b14377887 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.348772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699754cb-ee69-4eb4-a232-6d8070dd28f8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.349050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699754cb-ee69-4eb4-a232-6d8070dd28f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.349322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699754cb-ee69-4eb4-a232-6d8070dd28f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.349675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d729b-e581-4557-8944-1c5b14377887 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.350048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699754cb-ee69-4eb4-a232-6d8070dd28f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:46.350353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699754cb-ee69-4eb4-a232-6d8070dd28f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.350465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451d729b-e581-4557-8944-1c5b14377887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.351747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699754cb-ee69-4eb4-a232-6d8070dd28f8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.363926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 431/849] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:46.370640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699754cb-ee69-4eb4-a232-6d8070dd28f8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.372071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-451d729b-e581-4557-8944-1c5b14377887 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:46.373636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-451d729b-e581-4557-8944-1c5b14377887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:46.399563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.451799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 419/850] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:46 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:46.474827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d729b-e581-4557-8944-1c5b14377887 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.485552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699754cb-ee69-4eb4-a232-6d8070dd28f8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.527842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d62b2a-f5c0-493b-922f-88f8afadedbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.528779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d62b2a-f5c0-493b-922f-88f8afadedbd None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.529058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d62b2a-f5c0-493b-922f-88f8afadedbd None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.529620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d62b2a-f5c0-493b-922f-88f8afadedbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.538166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d62b2a-f5c0-493b-922f-88f8afadedbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.540284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d62b2a-f5c0-493b-922f-88f8afadedbd None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f6d62b2a-f5c0-493b-922f-88f8afadedbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:46.558796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:46.559742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:46.560678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:46.560678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:46.560678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:46.560678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:46.560678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:46.560678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:46.560678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:46.560678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:46.560678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 432/851] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:46.567970 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d62b2a-f5c0-493b-922f-88f8afadedbd None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.584148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451d729b-e581-4557-8944-1c5b14377887 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.618701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.630653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36fe5a-d8c4-4928-b9da-d8377c705f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.632040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36fe5a-d8c4-4928-b9da-d8377c705f50 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.632938 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36fe5a-d8c4-4928-b9da-d8377c705f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.633524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36fe5a-d8c4-4928-b9da-d8377c705f50 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.634452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36fe5a-d8c4-4928-b9da-d8377c705f50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.636953 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36fe5a-d8c4-4928-b9da-d8377c705f50 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-8e36fe5a-d8c4-4928-b9da-d8377c705f50 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:46.653551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:46.654526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:05:46.655417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:46.657023 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 420/852] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:46.662701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36fe5a-d8c4-4928-b9da-d8377c705f50 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.670034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.692363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d62b2a-f5c0-493b-922f-88f8afadedbd None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.729815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30041670-70a7-4471-b195-94fb18bfde40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.730396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041670-70a7-4471-b195-94fb18bfde40 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.730681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041670-70a7-4471-b195-94fb18bfde40 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.730976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30041670-70a7-4471-b195-94fb18bfde40 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.731782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30041670-70a7-4471-b195-94fb18bfde40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:46.732098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30041670-70a7-4471-b195-94fb18bfde40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.733769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30041670-70a7-4471-b195-94fb18bfde40 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.751992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 433/853] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:46.754114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30041670-70a7-4471-b195-94fb18bfde40 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.782745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36fe5a-d8c4-4928-b9da-d8377c705f50 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.826305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13454b6-6699-420f-a33e-0d7b8d539caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.827410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13454b6-6699-420f-a33e-0d7b8d539caf None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.827910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13454b6-6699-420f-a33e-0d7b8d539caf None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.828367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13454b6-6699-420f-a33e-0d7b8d539caf None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.829291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13454b6-6699-420f-a33e-0d7b8d539caf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:46.829901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13454b6-6699-420f-a33e-0d7b8d539caf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.831930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13454b6-6699-420f-a33e-0d7b8d539caf None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.842018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 421/854] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:46.843441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13454b6-6699-420f-a33e-0d7b8d539caf None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:46.865360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30041670-70a7-4471-b195-94fb18bfde40 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:46.902411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa8a73-2370-458c-aba7-7ce7e8df27ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:46.903496 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa8a73-2370-458c-aba7-7ce7e8df27ae None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:46.903496 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa8a73-2370-458c-aba7-7ce7e8df27ae None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:46.903802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa8a73-2370-458c-aba7-7ce7e8df27ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:46.904611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa8a73-2370-458c-aba7-7ce7e8df27ae None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=4bfb2a63f46a4a419da65805253ef7ac) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:46.904930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa8a73-2370-458c-aba7-7ce7e8df27ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:46.906382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa8a73-2370-458c-aba7-7ce7e8df27ae None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:46.907224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:46.923197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 434/855] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/role_assignments?user.id=4bfb2a63f46a4a419da65805253ef7ac&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:46.966575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13454b6-6699-420f-a33e-0d7b8d539caf None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.006889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa7853-e341-46b8-bea7-b122ed0e85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.007942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa7853-e341-46b8-bea7-b122ed0e85a3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.008457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa7853-e341-46b8-bea7-b122ed0e85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.008993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa7853-e341-46b8-bea7-b122ed0e85a3 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.009971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa7853-e341-46b8-bea7-b122ed0e85a3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:47.010488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa7853-e341-46b8-bea7-b122ed0e85a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.012153 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa7853-e341-46b8-bea7-b122ed0e85a3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.018850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 422/856] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:05:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:47.215457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eef943-ba9c-45eb-80db-f4103770d711 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.216033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eef943-ba9c-45eb-80db-f4103770d711 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.216486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eef943-ba9c-45eb-80db-f4103770d711 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.218271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 435/857] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:47.226295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580622d-c7b9-4e49-90a1-e1e78710f9a1 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.227077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580622d-c7b9-4e49-90a1-e1e78710f9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.227556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580622d-c7b9-4e49-90a1-e1e78710f9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.240239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d22579-85e3-4f09-92bb-e09f9ab44071 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.240532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d22579-85e3-4f09-92bb-e09f9ab44071 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.240815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d22579-85e3-4f09-92bb-e09f9ab44071 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.242401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 436/858] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:47.245865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1580622d-c7b9-4e49-90a1-e1e78710f9a1 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:47.247270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1580622d-c7b9-4e49-90a1-e1e78710f9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:47.247378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3424a4-c725-4d2a-9c3c-30ffbca693a7 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.247657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3424a4-c725-4d2a-9c3c-30ffbca693a7 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.247937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3424a4-c725-4d2a-9c3c-30ffbca693a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.259766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.267014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-9a3424a4-c725-4d2a-9c3c-30ffbca693a7 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:47.269165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9a3424a4-c725-4d2a-9c3c-30ffbca693a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:47.324598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 423/859] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:47.349608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580622d-c7b9-4e49-90a1-e1e78710f9a1 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.361504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 437/860] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:47 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:47.384932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3424a4-c725-4d2a-9c3c-30ffbca693a7 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.408813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.479046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580622d-c7b9-4e49-90a1-e1e78710f9a1 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.511873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3424a4-c725-4d2a-9c3c-30ffbca693a7 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.532660 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595566-efb4-4da0-8a02-b02188e5d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.533688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595566-efb4-4da0-8a02-b02188e5d9ad None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.534159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595566-efb4-4da0-8a02-b02188e5d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.536121 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595566-efb4-4da0-8a02-b02188e5d9ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.548260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d595566-efb4-4da0-8a02-b02188e5d9ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:47.552965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251846-31bf-4339-b3a4-e21d5b1f5f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.553861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251846-31bf-4339-b3a4-e21d5b1f5f58 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.554339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251846-31bf-4339-b3a4-e21d5b1f5f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.554811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0251846-31bf-4339-b3a4-e21d5b1f5f58 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.556384 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0251846-31bf-4339-b3a4-e21d5b1f5f58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-1d595566-efb4-4da0-8a02-b02188e5d9ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:47.556519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:47.557395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:47.558261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 424/861] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:47.560448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0251846-31bf-4339-b3a4-e21d5b1f5f58 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.564194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.564547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595566-efb4-4da0-8a02-b02188e5d9ad None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.586997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 438/862] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:05:47 2022] POST /identity/v3/services => generated 251 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:05:47.695097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595566-efb4-4da0-8a02-b02188e5d9ad None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.705222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:47.741461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41a4b2-a550-4c7e-ad7a-093aca391313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.742208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a4b2-a550-4c7e-ad7a-093aca391313 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.742490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a4b2-a550-4c7e-ad7a-093aca391313 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.742820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41a4b2-a550-4c7e-ad7a-093aca391313 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.743622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41a4b2-a550-4c7e-ad7a-093aca391313 None admin] RBAC: Adding query filter params (name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:47.743933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41a4b2-a550-4c7e-ad7a-093aca391313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.745347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41a4b2-a550-4c7e-ad7a-093aca391313 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.755707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 425/863] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:47.764330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251846-31bf-4339-b3a4-e21d5b1f5f58 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:47.875958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0251846-31bf-4339-b3a4-e21d5b1f5f58 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:47.911511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fcefb-c162-4253-899a-893d0c834e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:47.912300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fcefb-c162-4253-899a-893d0c834e2f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:47.912576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fcefb-c162-4253-899a-893d0c834e2f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:47.912848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fcefb-c162-4253-899a-893d0c834e2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:47.922965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fcefb-c162-4253-899a-893d0c834e2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:47.924423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fcefb-c162-4253-899a-893d0c834e2f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-d76fcefb-c162-4253-899a-893d0c834e2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:47.942181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:47.943229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:47.944132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:47.944132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:47.944132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:47.944132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:47.944132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 439/864] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:47.949281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41a4b2-a550-4c7e-ad7a-093aca391313 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.057484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41a4b2-a550-4c7e-ad7a-093aca391313 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.093112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d5e2-9c09-4cf3-b67f-e48577232010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.094126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d5e2-9c09-4cf3-b67f-e48577232010 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.094629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d5e2-9c09-4cf3-b67f-e48577232010 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.095148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354d5e2-9c09-4cf3-b67f-e48577232010 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.096087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d5e2-9c09-4cf3-b67f-e48577232010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:48.096700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d5e2-9c09-4cf3-b67f-e48577232010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.098284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354d5e2-9c09-4cf3-b67f-e48577232010 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.111607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 426/865] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:48.119105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fcefb-c162-4253-899a-893d0c834e2f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.185141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:48.239463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fcefb-c162-4253-899a-893d0c834e2f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.273909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b16ce-8230-460a-93bb-ee2013840930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.274713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b16ce-8230-460a-93bb-ee2013840930 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.275037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b16ce-8230-460a-93bb-ee2013840930 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.275312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b16ce-8230-460a-93bb-ee2013840930 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.282442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b16ce-8230-460a-93bb-ee2013840930 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.284506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6b16ce-8230-460a-93bb-ee2013840930 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-0c6b16ce-8230-460a-93bb-ee2013840930 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:48.300298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:48.301280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:48.302208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 440/866] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:48.307372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d5e2-9c09-4cf3-b67f-e48577232010 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.335898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:48.412411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354d5e2-9c09-4cf3-b67f-e48577232010 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.447771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7e79-1e81-49b7-8171-e44bd96f5d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.448822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7e79-1e81-49b7-8171-e44bd96f5d08 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.449305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7e79-1e81-49b7-8171-e44bd96f5d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.449777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd7e79-1e81-49b7-8171-e44bd96f5d08 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.450801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd7e79-1e81-49b7-8171-e44bd96f5d08 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:48.451328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd7e79-1e81-49b7-8171-e44bd96f5d08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.452963 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd7e79-1e81-49b7-8171-e44bd96f5d08 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.471176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 427/867] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:48.479076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b16ce-8230-460a-93bb-ee2013840930 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.581036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b16ce-8230-460a-93bb-ee2013840930 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.590825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:48.616506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eec0c-fd5b-4139-96a2-6673f92798f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.617156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eec0c-fd5b-4139-96a2-6673f92798f4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.617435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eec0c-fd5b-4139-96a2-6673f92798f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.617706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3eec0c-fd5b-4139-96a2-6673f92798f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.687247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eec0c-fd5b-4139-96a2-6673f92798f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.688734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3eec0c-fd5b-4139-96a2-6673f92798f4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.790320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 441/868] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:05:48.795944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7e79-1e81-49b7-8171-e44bd96f5d08 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.887511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:48.905282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd7e79-1e81-49b7-8171-e44bd96f5d08 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:48.943395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec67435-3ada-46be-96ac-18aa6dc29fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:48.944182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67435-3ada-46be-96ac-18aa6dc29fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:48.944459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67435-3ada-46be-96ac-18aa6dc29fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:48.944729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec67435-3ada-46be-96ac-18aa6dc29fd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:48.955627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec67435-3ada-46be-96ac-18aa6dc29fd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:48.958063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec67435-3ada-46be-96ac-18aa6dc29fd4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-5ec67435-3ada-46be-96ac-18aa6dc29fd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:48.976274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:48.977187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:48.978075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:48.978075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:48.978075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:48.978075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:48.978075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 428/869] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:48.983553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eec0c-fd5b-4139-96a2-6673f92798f4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:48.999342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.087391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3eec0c-fd5b-4139-96a2-6673f92798f4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.101241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad2d7a-e910-449b-af88-456fb66335bc None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.101562 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad2d7a-e910-449b-af88-456fb66335bc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.101800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ad2d7a-e910-449b-af88-456fb66335bc None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.103735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 429/870] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:49.109363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0f7ac-33cf-44f2-b8f6-b3fc924e5eab None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.109883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0f7ac-33cf-44f2-b8f6-b3fc924e5eab None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.110371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b0f7ac-33cf-44f2-b8f6-b3fc924e5eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.131162 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e1b0f7ac-33cf-44f2-b8f6-b3fc924e5eab None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:49.132378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e1b0f7ac-33cf-44f2-b8f6-b3fc924e5eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:49.134710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3423c-3265-404b-a6c2-9d43fdccfd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.136466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3423c-3265-404b-a6c2-9d43fdccfd60 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.136962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3423c-3265-404b-a6c2-9d43fdccfd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.137439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb3423c-3265-404b-a6c2-9d43fdccfd60 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.138443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3423c-3265-404b-a6c2-9d43fdccfd60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:49.138991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3423c-3265-404b-a6c2-9d43fdccfd60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.140999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb3423c-3265-404b-a6c2-9d43fdccfd60 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.156698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 442/871] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:49.162199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3423c-3265-404b-a6c2-9d43fdccfd60 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.211922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 430/872] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:05:49.214451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962dc7-b4ba-4cc3-94e6-c58e44d998c6 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.215375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962dc7-b4ba-4cc3-94e6-c58e44d998c6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.215857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02962dc7-b4ba-4cc3-94e6-c58e44d998c6 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.218306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 431/873] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:49.224734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7da4-008e-4f4b-bd9b-bb2a850487c8 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.225250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7da4-008e-4f4b-bd9b-bb2a850487c8 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.225723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7da4-008e-4f4b-bd9b-bb2a850487c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.242621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d47b7da4-008e-4f4b-bd9b-bb2a850487c8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:49.244090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d47b7da4-008e-4f4b-bd9b-bb2a850487c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:49.245413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.282850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb3423c-3265-404b-a6c2-9d43fdccfd60 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.308682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.320153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3036b32-07dc-4836-8dba-94aec96a3a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.320986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3036b32-07dc-4836-8dba-94aec96a3a01 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.321269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3036b32-07dc-4836-8dba-94aec96a3a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.321542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3036b32-07dc-4836-8dba-94aec96a3a01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.327390 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 432/874] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:49 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:49.328588 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3036b32-07dc-4836-8dba-94aec96a3a01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.328945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b7da4-008e-4f4b-bd9b-bb2a850487c8 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.330149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3036b32-07dc-4836-8dba-94aec96a3a01 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-b3036b32-07dc-4836-8dba-94aec96a3a01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:49.345594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:49.347522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:49.348487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:49.348487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:49.348487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:49.348487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:49.348487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:49.348487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:49.348487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:49.348487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:49.352194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 443/875] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:49.352838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3036b32-07dc-4836-8dba-94aec96a3a01 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.440411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b7da4-008e-4f4b-bd9b-bb2a850487c8 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.457740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3036b32-07dc-4836-8dba-94aec96a3a01 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.476270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084cdb-ab37-4851-98d1-4ad19a622721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.477087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084cdb-ab37-4851-98d1-4ad19a622721 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.477368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084cdb-ab37-4851-98d1-4ad19a622721 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.477640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88084cdb-ab37-4851-98d1-4ad19a622721 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.478297 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88084cdb-ab37-4851-98d1-4ad19a622721 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.479771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88084cdb-ab37-4851-98d1-4ad19a622721 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.489267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-88084cdb-ab37-4851-98d1-4ad19a622721 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:49.491937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:49.493138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:49.494386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 433/876] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:49.495211 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084cdb-ab37-4851-98d1-4ad19a622721 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.502397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d87b0a-e42a-47ce-9bda-5b4285f77ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.503347 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87b0a-e42a-47ce-9bda-5b4285f77ec4 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.503706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87b0a-e42a-47ce-9bda-5b4285f77ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.503983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d87b0a-e42a-47ce-9bda-5b4285f77ec4 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.504701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87b0a-e42a-47ce-9bda-5b4285f77ec4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.506195 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d87b0a-e42a-47ce-9bda-5b4285f77ec4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.520885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 444/877] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:05:49 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:49.523950 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d87b0a-e42a-47ce-9bda-5b4285f77ec4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.595423 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.621771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88084cdb-ab37-4851-98d1-4ad19a622721 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.652944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d87b0a-e42a-47ce-9bda-5b4285f77ec4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.663235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a099c4f-9f8b-472d-ab48-ca0c16753fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.664371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a099c4f-9f8b-472d-ab48-ca0c16753fbf None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.664861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a099c4f-9f8b-472d-ab48-ca0c16753fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.665485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a099c4f-9f8b-472d-ab48-ca0c16753fbf None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.666557 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a099c4f-9f8b-472d-ab48-ca0c16753fbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:49.667141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a099c4f-9f8b-472d-ab48-ca0c16753fbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.669496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a099c4f-9f8b-472d-ab48-ca0c16753fbf None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.689079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 434/878] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:49.692533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a099c4f-9f8b-472d-ab48-ca0c16753fbf None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.693108 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b77c2-5e64-44eb-ad72-7c7db75a7c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.693786 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b77c2-5e64-44eb-ad72-7c7db75a7c2f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.694067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b77c2-5e64-44eb-ad72-7c7db75a7c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.694339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27b77c2-5e64-44eb-ad72-7c7db75a7c2f None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.695885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b77c2-5e64-44eb-ad72-7c7db75a7c2f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:49.696201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b77c2-5e64-44eb-ad72-7c7db75a7c2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.698279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27b77c2-5e64-44eb-ad72-7c7db75a7c2f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.703712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 445/879] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:49.709886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b77c2-5e64-44eb-ad72-7c7db75a7c2f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:49.769925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.829188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a099c4f-9f8b-472d-ab48-ca0c16753fbf None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.834430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27b77c2-5e64-44eb-ad72-7c7db75a7c2f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:49.853010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:49.872215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2a90a-1cea-4e55-aec2-b3ceb424beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.872872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2a90a-1cea-4e55-aec2-b3ceb424beef None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.873155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2a90a-1cea-4e55-aec2-b3ceb424beef None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.873473 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2a90a-1cea-4e55-aec2-b3ceb424beef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.874303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2a90a-1cea-4e55-aec2-b3ceb424beef None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=a9da3c101fd64bb496c7e5512edc9bf0) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:49.874615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2a90a-1cea-4e55-aec2-b3ceb424beef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.876079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a2a90a-1cea-4e55-aec2-b3ceb424beef None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.881946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb8a1-37bc-4726-9fe3-66f9f4184f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:49.882791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb8a1-37bc-4726-9fe3-66f9f4184f71 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.890146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 435/880] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/role_assignments?user.id=a9da3c101fd64bb496c7e5512edc9bf0&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:49.890334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb8a1-37bc-4726-9fe3-66f9f4184f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.890334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142cb8a1-37bc-4726-9fe3-66f9f4184f71 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.890334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cb8a1-37bc-4726-9fe3-66f9f4184f71 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:49.890334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cb8a1-37bc-4726-9fe3-66f9f4184f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:49.890334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142cb8a1-37bc-4726-9fe3-66f9f4184f71 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:49.894902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd8e70-d35c-4319-b5e8-e751d017f5fb None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.895210 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd8e70-d35c-4319-b5e8-e751d017f5fb None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.895483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd8e70-d35c-4319-b5e8-e751d017f5fb None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.897090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 436/881] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:49.901276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 446/882] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 21 04:05:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:49.903080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6847f-4140-49fa-b3ac-8989333579a5 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:49.903365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6847f-4140-49fa-b3ac-8989333579a5 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:49.903637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd6847f-4140-49fa-b3ac-8989333579a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:49.923352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-8dd6847f-4140-49fa-b3ac-8989333579a5 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:49.925308 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8dd6847f-4140-49fa-b3ac-8989333579a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:50.014162 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 437/883] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:50.038582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb8a1-37bc-4726-9fe3-66f9f4184f71 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.154279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142cb8a1-37bc-4726-9fe3-66f9f4184f71 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.169234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:50.192345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0415-20a9-4096-ab88-4621e8f582e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.193149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0415-20a9-4096-ab88-4621e8f582e1 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.193434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0415-20a9-4096-ab88-4621e8f582e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.193713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a0415-20a9-4096-ab88-4621e8f582e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.194370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0415-20a9-4096-ab88-4621e8f582e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.195783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a0415-20a9-4096-ab88-4621e8f582e1 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-8e2a0415-20a9-4096-ab88-4621e8f582e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:50.208941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:50.209967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:05:50.210806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:50.215246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 447/884] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:50.216469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6847f-4140-49fa-b3ac-8989333579a5 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.325482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd6847f-4140-49fa-b3ac-8989333579a5 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.341047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:50.362883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a781c21-5bc5-4f3c-a466-cabbe533fa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.363630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a781c21-5bc5-4f3c-a466-cabbe533fa9e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.363919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a781c21-5bc5-4f3c-a466-cabbe533fa9e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.364200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a781c21-5bc5-4f3c-a466-cabbe533fa9e None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.364910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a781c21-5bc5-4f3c-a466-cabbe533fa9e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:50.365219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a781c21-5bc5-4f3c-a466-cabbe533fa9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.366611 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a781c21-5bc5-4f3c-a466-cabbe533fa9e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.371851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 438/885] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:50.377430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0415-20a9-4096-ab88-4621e8f582e1 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.487643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a0415-20a9-4096-ab88-4621e8f582e1 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.522609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b31d2-4860-45c6-b419-395f187e762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.523694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b31d2-4860-45c6-b419-395f187e762e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.524198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b31d2-4860-45c6-b419-395f187e762e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.524703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463b31d2-4860-45c6-b419-395f187e762e None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.525607 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b31d2-4860-45c6-b419-395f187e762e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:50.526134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b31d2-4860-45c6-b419-395f187e762e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.527724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463b31d2-4860-45c6-b419-395f187e762e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.533401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 448/886] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:50.539862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a781c21-5bc5-4f3c-a466-cabbe533fa9e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.647532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a781c21-5bc5-4f3c-a466-cabbe533fa9e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.682890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3819b-44be-493b-9666-df7f29733246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.683570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3819b-44be-493b-9666-df7f29733246 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.683851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3819b-44be-493b-9666-df7f29733246 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.684125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3819b-44be-493b-9666-df7f29733246 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.684912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3819b-44be-493b-9666-df7f29733246 None admin] RBAC: Adding query filter params (interface=public, service_id=7cab67004af649eb9588cf4226fdcbfb, region_id=RegionOne) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:50.685219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3819b-44be-493b-9666-df7f29733246 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.686587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3819b-44be-493b-9666-df7f29733246 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.692729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 439/887] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/endpoints?service_id=7cab67004af649eb9588cf4226fdcbfb&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:50.697922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b31d2-4860-45c6-b419-395f187e762e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:50.744626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:50.808444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463b31d2-4860-45c6-b419-395f187e762e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:50.849716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2874233-e9f5-4907-888e-ceed8b5d80a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:50.851231 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874233-e9f5-4907-888e-ceed8b5d80a0 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:50.851726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874233-e9f5-4907-888e-ceed8b5d80a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:50.852202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2874233-e9f5-4907-888e-ceed8b5d80a0 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:50.853752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2874233-e9f5-4907-888e-ceed8b5d80a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:50.855385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2874233-e9f5-4907-888e-ceed8b5d80a0 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:50.862286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 449/888] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 21 04:05:50 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:05:51.706397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fedc7d-7793-4e50-abc7-757f0ba36e68 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:51.706944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fedc7d-7793-4e50-abc7-757f0ba36e68 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:51.706944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fedc7d-7793-4e50-abc7-757f0ba36e68 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:51.708630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 440/889] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:51.714223 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729025aa-bbbe-4c19-af48-8b8f64a2778e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:51.714507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729025aa-bbbe-4c19-af48-8b8f64a2778e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:51.714787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729025aa-bbbe-4c19-af48-8b8f64a2778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:51.732320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-729025aa-bbbe-4c19-af48-8b8f64a2778e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:51.733490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-729025aa-bbbe-4c19-af48-8b8f64a2778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:51.807165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 450/890] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:51.824066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fedc7d-7793-4e50-abc7-757f0ba36e68 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:51.872293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:51.937578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fedc7d-7793-4e50-abc7-757f0ba36e68 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:51.972907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b1897-dfb5-4f4c-b38b-46dfe1f06b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:51.973632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b1897-dfb5-4f4c-b38b-46dfe1f06b6f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:51.973912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b1897-dfb5-4f4c-b38b-46dfe1f06b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:51.974184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b1897-dfb5-4f4c-b38b-46dfe1f06b6f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:51.974842 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b1897-dfb5-4f4c-b38b-46dfe1f06b6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:51.976244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b1897-dfb5-4f4c-b38b-46dfe1f06b6f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-fa8b1897-dfb5-4f4c-b38b-46dfe1f06b6f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:51.989815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:51.990868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:51.991759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 441/891] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jul 21 04:05:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:51.997525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729025aa-bbbe-4c19-af48-8b8f64a2778e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.034704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:52.066425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdefa43-29e0-46a6-a506-5076ac0fba0d None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.066766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdefa43-29e0-46a6-a506-5076ac0fba0d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.067004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdefa43-29e0-46a6-a506-5076ac0fba0d None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.068540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 442/892] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:52.073396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1742-9fe6-4bb0-b20e-038ee07d9c68 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.073683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1742-9fe6-4bb0-b20e-038ee07d9c68 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.073959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1742-9fe6-4bb0-b20e-038ee07d9c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.091172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-9d1b1742-9fe6-4bb0-b20e-038ee07d9c68 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:52.092350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9d1b1742-9fe6-4bb0-b20e-038ee07d9c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:52.117012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729025aa-bbbe-4c19-af48-8b8f64a2778e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:52.155237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061f99e-5b3f-4883-aa34-e81f3ceb35d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:52.156287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f99e-5b3f-4883-aa34-e81f3ceb35d4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.156791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f99e-5b3f-4883-aa34-e81f3ceb35d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.157354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4061f99e-5b3f-4883-aa34-e81f3ceb35d4 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.158359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061f99e-5b3f-4883-aa34-e81f3ceb35d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:52.158890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061f99e-5b3f-4883-aa34-e81f3ceb35d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:52.160772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4061f99e-5b3f-4883-aa34-e81f3ceb35d4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:52.170481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 443/894] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:52 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:05:52.170914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 451/894] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:05:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:52.172370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1742-9fe6-4bb0-b20e-038ee07d9c68 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.192228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061f99e-5b3f-4883-aa34-e81f3ceb35d4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.218144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:52.294466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1742-9fe6-4bb0-b20e-038ee07d9c68 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:52.299362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:52.303240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4061f99e-5b3f-4883-aa34-e81f3ceb35d4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:52.332011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6354a09a-a353-4f49-a428-b4813061d700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:52.332670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a09a-a353-4f49-a428-b4813061d700 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.332953 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a09a-a353-4f49-a428-b4813061d700 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.333233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6354a09a-a353-4f49-a428-b4813061d700 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.333933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354a09a-a353-4f49-a428-b4813061d700 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:52.334238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354a09a-a353-4f49-a428-b4813061d700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:52.335630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6354a09a-a353-4f49-a428-b4813061d700 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:52.341018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 444/895] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:05:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:52.342097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894548a-8d27-47bb-94d3-b746a0098402 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.342388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894548a-8d27-47bb-94d3-b746a0098402 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.342676 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894548a-8d27-47bb-94d3-b746a0098402 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.343444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7a0370-ac2c-4656-81a6-e5cd87587498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:52.343905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 445/896] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:52.344572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a0370-ac2c-4656-81a6-e5cd87587498 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.345062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a0370-ac2c-4656-81a6-e5cd87587498 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.345537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7a0370-ac2c-4656-81a6-e5cd87587498 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.347074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a0370-ac2c-4656-81a6-e5cd87587498 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:52.348688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7a0370-ac2c-4656-81a6-e5cd87587498 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:52.349518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894548a-8d27-47bb-94d3-b746a0098402 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.362638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 452/897] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:05:52 2022] POST /identity/v3/services => generated 241 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:05:52.362638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f076-9623-4f91-9359-fac1b927c258 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.362638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f076-9623-4f91-9359-fac1b927c258 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.362638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f076-9623-4f91-9359-fac1b927c258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.395344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1616f076-9623-4f91-9359-fac1b927c258 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:52.397423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1616f076-9623-4f91-9359-fac1b927c258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:52.464492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:52.476279 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894548a-8d27-47bb-94d3-b746a0098402 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:52.511510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 453/898] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:52.519717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bfd09-ef31-4ee0-9ed6-60f4bebb0a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:52.519982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bfd09-ef31-4ee0-9ed6-60f4bebb0a49 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.520268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bfd09-ef31-4ee0-9ed6-60f4bebb0a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.520543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4bfd09-ef31-4ee0-9ed6-60f4bebb0a49 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.521376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bfd09-ef31-4ee0-9ed6-60f4bebb0a49 None admin] RBAC: Adding query filter params (interface=public, service_id=71fb72e21e5a408d9738f8d79e737354, region_id=RegionOne) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:52.522274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bfd09-ef31-4ee0-9ed6-60f4bebb0a49 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:52.523092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4bfd09-ef31-4ee0-9ed6-60f4bebb0a49 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:52.529618 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 446/899] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 21 04:05:52 2022] GET /identity/v3/endpoints?service_id=71fb72e21e5a408d9738f8d79e737354&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:52.532276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f076-9623-4f91-9359-fac1b927c258 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.535874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bfd09-ef31-4ee0-9ed6-60f4bebb0a49 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.645400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:52.660476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f076-9623-4f91-9359-fac1b927c258 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:52.669204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4bfd09-ef31-4ee0-9ed6-60f4bebb0a49 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:52.697822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798bea4-8c44-4aec-88ff-43c488b828e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:52.698774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798bea4-8c44-4aec-88ff-43c488b828e7 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.699178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798bea4-8c44-4aec-88ff-43c488b828e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.699549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798bea4-8c44-4aec-88ff-43c488b828e7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.711101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1798bea4-8c44-4aec-88ff-43c488b828e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:52.713950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaa7dd-6f93-4d21-ab7f-e89b75585ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:52.715135 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa7dd-6f93-4d21-ab7f-e89b75585ba3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.715581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa7dd-6f93-4d21-ab7f-e89b75585ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.716090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aaa7dd-6f93-4d21-ab7f-e89b75585ba3 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.716924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaa7dd-6f93-4d21-ab7f-e89b75585ba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:52.718563 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aaa7dd-6f93-4d21-ab7f-e89b75585ba3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-1798bea4-8c44-4aec-88ff-43c488b828e7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:52.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:52.722528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:05:52.723583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:52.733884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 454/901] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 21 04:05:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:52.733884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798bea4-8c44-4aec-88ff-43c488b828e7 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.734519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 447/901] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 21 04:05:52 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:05:52.854016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798bea4-8c44-4aec-88ff-43c488b828e7 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:52.894018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83645ef3-59a6-41f5-9376-30b555fea165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:52.894695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645ef3-59a6-41f5-9376-30b555fea165 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.894995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645ef3-59a6-41f5-9376-30b555fea165 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.895275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83645ef3-59a6-41f5-9376-30b555fea165 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.896088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83645ef3-59a6-41f5-9376-30b555fea165 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:52.896395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83645ef3-59a6-41f5-9376-30b555fea165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:52.897788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83645ef3-59a6-41f5-9376-30b555fea165 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:52.906839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 455/902] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 21 04:05:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:52.913060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaa7dd-6f93-4d21-ab7f-e89b75585ba3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:52.939763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:52.965553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904fe83-23d3-4445-acdb-f2f1d729ff12 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.965891 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904fe83-23d3-4445-acdb-f2f1d729ff12 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.966344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904fe83-23d3-4445-acdb-f2f1d729ff12 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.968007 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 456/903] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:52.975953 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7895b5-c9e0-419a-a4a4-0152353a9133 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:52.976367 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7895b5-c9e0-419a-a4a4-0152353a9133 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:52.976746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7895b5-c9e0-419a-a4a4-0152353a9133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:52.994931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-bd7895b5-c9e0-419a-a4a4-0152353a9133 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:52.996395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-bd7895b5-c9e0-419a-a4a4-0152353a9133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:53.001066 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.042001 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aaa7dd-6f93-4d21-ab7f-e89b75585ba3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.077411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 457/904] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:05:53.085654 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04499e-c1a9-4b1f-8028-232a9f9f1a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.086769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04499e-c1a9-4b1f-8028-232a9f9f1a60 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.087305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04499e-c1a9-4b1f-8028-232a9f9f1a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.087802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c04499e-c1a9-4b1f-8028-232a9f9f1a60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.100365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04499e-c1a9-4b1f-8028-232a9f9f1a60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.102064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7895b5-c9e0-419a-a4a4-0152353a9133 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.104297 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c04499e-c1a9-4b1f-8028-232a9f9f1a60 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-7c04499e-c1a9-4b1f-8028-232a9f9f1a60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:53.123273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:53.124216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:53.125088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:53.125088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:53.125088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:53.125088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:53.127389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 448/905] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:53.132735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04499e-c1a9-4b1f-8028-232a9f9f1a60 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.218851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.223925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7895b5-c9e0-419a-a4a4-0152353a9133 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.244775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c04499e-c1a9-4b1f-8028-232a9f9f1a60 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.266429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1d844-a604-439c-b601-d7d9330d0109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.267356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1d844-a604-439c-b601-d7d9330d0109 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.267641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1d844-a604-439c-b601-d7d9330d0109 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.267916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c1d844-a604-439c-b601-d7d9330d0109 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.269133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1d844-a604-439c-b601-d7d9330d0109 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.270621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c1d844-a604-439c-b601-d7d9330d0109 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.281934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7b21-ee31-49de-9300-b72038496cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.282604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7b21-ee31-49de-9300-b72038496cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.282892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7b21-ee31-49de-9300-b72038496cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-31c1d844-a604-439c-b601-d7d9330d0109 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:53.283104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:53.284585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 21 04:05:53.285679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:53.286579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea7b21-ee31-49de-9300-b72038496cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.286579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea7b21-ee31-49de-9300-b72038496cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:53.286579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea7b21-ee31-49de-9300-b72038496cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.286804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 458/906] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:53.286886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddea7b21-ee31-49de-9300-b72038496cc7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.293156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1d844-a604-439c-b601-d7d9330d0109 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.297091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.300685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 449/907] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:53.306491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7b21-ee31-49de-9300-b72038496cc7 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.410378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c1d844-a604-439c-b601-d7d9330d0109 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.417997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea7b21-ee31-49de-9300-b72038496cc7 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.449338 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720f31a-9fa6-4f1c-abfd-f42ceae93cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.450099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720f31a-9fa6-4f1c-abfd-f42ceae93cdd None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.450456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720f31a-9fa6-4f1c-abfd-f42ceae93cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.450801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720f31a-9fa6-4f1c-abfd-f42ceae93cdd None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.451742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720f31a-9fa6-4f1c-abfd-f42ceae93cdd None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:53.452119 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720f31a-9fa6-4f1c-abfd-f42ceae93cdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.453600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720f31a-9fa6-4f1c-abfd-f42ceae93cdd None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.457623 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07088f-a65b-43cc-9b3e-cd1257fb727b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.458699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07088f-a65b-43cc-9b3e-cd1257fb727b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.459189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07088f-a65b-43cc-9b3e-cd1257fb727b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.459667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07088f-a65b-43cc-9b3e-cd1257fb727b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.459919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 459/908] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:53.463501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.465348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720f31a-9fa6-4f1c-abfd-f42ceae93cdd None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.469968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07088f-a65b-43cc-9b3e-cd1257fb727b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.471770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07088f-a65b-43cc-9b3e-cd1257fb727b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-be07088f-a65b-43cc-9b3e-cd1257fb727b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:53.488043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:53.489005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:53.489958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:53.489958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:53.489958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:53.489958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:53.489958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:53.489958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:53.489958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:53.489958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:53.489958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:53.489958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:53.492758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 450/909] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:53.498500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07088f-a65b-43cc-9b3e-cd1257fb727b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.562181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.607676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720f31a-9fa6-4f1c-abfd-f42ceae93cdd None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.635209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07088f-a65b-43cc-9b3e-cd1257fb727b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.653424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f371a-8795-411b-a6e0-91bd87781b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.654091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f371a-8795-411b-a6e0-91bd87781b41 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.654398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f371a-8795-411b-a6e0-91bd87781b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.655052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334f371a-8795-411b-a6e0-91bd87781b41 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.656039 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f371a-8795-411b-a6e0-91bd87781b41 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:53.656358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f371a-8795-411b-a6e0-91bd87781b41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.657905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334f371a-8795-411b-a6e0-91bd87781b41 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.664246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 460/910] 10.222.0.48 () {56 vars in 1114 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:53.669385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f371a-8795-411b-a6e0-91bd87781b41 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.687353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f9b26-5038-4091-a061-de87931dbfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.688341 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9b26-5038-4091-a061-de87931dbfa6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.688860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9b26-5038-4091-a061-de87931dbfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.689333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19f9b26-5038-4091-a061-de87931dbfa6 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.691222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f9b26-5038-4091-a061-de87931dbfa6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:53.691757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f9b26-5038-4091-a061-de87931dbfa6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.693436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19f9b26-5038-4091-a061-de87931dbfa6 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.714035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 451/911] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:53.720014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f9b26-5038-4091-a061-de87931dbfa6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:53.784688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.792323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334f371a-8795-411b-a6e0-91bd87781b41 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.826057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:53.830728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19f9b26-5038-4091-a061-de87931dbfa6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:53.833492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd4dd-1cd6-4bbf-93e4-10fad206a8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.834404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd4dd-1cd6-4bbf-93e4-10fad206a8f8 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.835003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd4dd-1cd6-4bbf-93e4-10fad206a8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.835495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cd4dd-1cd6-4bbf-93e4-10fad206a8f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.836460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd4dd-1cd6-4bbf-93e4-10fad206a8f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.838285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cd4dd-1cd6-4bbf-93e4-10fad206a8f8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:53.867177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 461/912] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 21 04:05:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:05:53.877122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ea83d-1002-4e37-8339-813a14a14395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:53.878320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ea83d-1002-4e37-8339-813a14a14395 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:53.878320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ea83d-1002-4e37-8339-813a14a14395 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:53.878580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ea83d-1002-4e37-8339-813a14a14395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:53.960846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ea83d-1002-4e37-8339-813a14a14395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:53.962343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ea83d-1002-4e37-8339-813a14a14395 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.018737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.074174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 452/913] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:05:53 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:05:54.080214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd4dd-1cd6-4bbf-93e4-10fad206a8f8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.205356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cd4dd-1cd6-4bbf-93e4-10fad206a8f8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.241978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397b654-e7ec-4b56-8aa1-08cffd7e291f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.242779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b654-e7ec-4b56-8aa1-08cffd7e291f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.243092 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b654-e7ec-4b56-8aa1-08cffd7e291f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.243373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397b654-e7ec-4b56-8aa1-08cffd7e291f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.254554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397b654-e7ec-4b56-8aa1-08cffd7e291f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.256060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397b654-e7ec-4b56-8aa1-08cffd7e291f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-7397b654-e7ec-4b56-8aa1-08cffd7e291f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:54.274161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:54.275099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:54.276362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:54.276362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:54.276362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:54.276362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:54.276362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 462/914] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:54.282641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ea83d-1002-4e37-8339-813a14a14395 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.395991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ea83d-1002-4e37-8339-813a14a14395 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.437322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d0510-b62f-42e2-9930-d82545639df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.438372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d0510-b62f-42e2-9930-d82545639df0 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.438873 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d0510-b62f-42e2-9930-d82545639df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.439406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d0510-b62f-42e2-9930-d82545639df0 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.440416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d0510-b62f-42e2-9930-d82545639df0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:54.440991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d0510-b62f-42e2-9930-d82545639df0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.442670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d0510-b62f-42e2-9930-d82545639df0 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.459364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 453/915] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:54.461914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397b654-e7ec-4b56-8aa1-08cffd7e291f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.507669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf85fe8-843f-4117-b27b-c2354ecf5bfd None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.508002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf85fe8-843f-4117-b27b-c2354ecf5bfd None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.508230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf85fe8-843f-4117-b27b-c2354ecf5bfd None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.509724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.509927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 454/916] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:54.515004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7cb9c-fead-4039-a888-e187b0245a85 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.515293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7cb9c-fead-4039-a888-e187b0245a85 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.515614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b7cb9c-fead-4039-a888-e187b0245a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.535814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-12b7cb9c-fead-4039-a888-e187b0245a85 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:54.537115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-12b7cb9c-fead-4039-a888-e187b0245a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:54.589519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397b654-e7ec-4b56-8aa1-08cffd7e291f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.590199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.619410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 455/917] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:54.628669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57944d0-185c-44f3-8092-80b610a77215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.629477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57944d0-185c-44f3-8092-80b610a77215 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.629768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57944d0-185c-44f3-8092-80b610a77215 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.630050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57944d0-185c-44f3-8092-80b610a77215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.633725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7cb9c-fead-4039-a888-e187b0245a85 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.638128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57944d0-185c-44f3-8092-80b610a77215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.639624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57944d0-185c-44f3-8092-80b610a77215 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f57944d0-185c-44f3-8092-80b610a77215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:54.658576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:54.660470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:54.661865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:54.661865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:54.661865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:54.661865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:54.661865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:54.661865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:54.661865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:54.661865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:54.661865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 463/918] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:54.671954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57944d0-185c-44f3-8092-80b610a77215 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.744823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b7cb9c-fead-4039-a888-e187b0245a85 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.781061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb352327-f3d8-4708-993f-6e3012385394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.782154 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb352327-f3d8-4708-993f-6e3012385394 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.782291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb352327-f3d8-4708-993f-6e3012385394 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.782521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb352327-f3d8-4708-993f-6e3012385394 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.783222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb352327-f3d8-4708-993f-6e3012385394 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.785355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb352327-f3d8-4708-993f-6e3012385394 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-eb352327-f3d8-4708-993f-6e3012385394 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:54.798103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:54.799592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:05:54.800478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:54.804701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 456/919] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:54.805624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb352327-f3d8-4708-993f-6e3012385394 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.807722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.810309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:54.813196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57944d0-185c-44f3-8092-80b610a77215 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.862704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1f8ed-452d-4d29-ae8e-53cc27cc0748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.863417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1f8ed-452d-4d29-ae8e-53cc27cc0748 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.863711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1f8ed-452d-4d29-ae8e-53cc27cc0748 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.864142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1f8ed-452d-4d29-ae8e-53cc27cc0748 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.864954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1f8ed-452d-4d29-ae8e-53cc27cc0748 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:54.865659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1f8ed-452d-4d29-ae8e-53cc27cc0748 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.867430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1f8ed-452d-4d29-ae8e-53cc27cc0748 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.884039 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 464/920] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:54.890104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1f8ed-452d-4d29-ae8e-53cc27cc0748 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.926860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb352327-f3d8-4708-993f-6e3012385394 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:54.963908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1944c-1c2c-4b50-8c28-3e74ed5fcca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:54.964577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1944c-1c2c-4b50-8c28-3e74ed5fcca7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.964863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1944c-1c2c-4b50-8c28-3e74ed5fcca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.965138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1944c-1c2c-4b50-8c28-3e74ed5fcca7 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.965962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1944c-1c2c-4b50-8c28-3e74ed5fcca7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:54.966293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1944c-1c2c-4b50-8c28-3e74ed5fcca7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:54.967897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1944c-1c2c-4b50-8c28-3e74ed5fcca7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:54.975332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 457/921] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:54.975332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5198-ef69-4da5-8822-797ebf65b739 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:54.975332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5198-ef69-4da5-8822-797ebf65b739 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:54.975647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5198-ef69-4da5-8822-797ebf65b739 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:54.977174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 458/922] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:54.978763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe5198-ef69-4da5-8822-797ebf65b739 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:54.999494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1f8ed-452d-4d29-ae8e-53cc27cc0748 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.039775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387b05a-b4ce-417f-8849-893bba0253f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.040432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387b05a-b4ce-417f-8849-893bba0253f4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.040717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387b05a-b4ce-417f-8849-893bba0253f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.040996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387b05a-b4ce-417f-8849-893bba0253f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.041828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387b05a-b4ce-417f-8849-893bba0253f4 None admin] RBAC: Adding query filter params (role.id=683c59f919e14e338161fe36d0f44320, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=a9da3c101fd64bb496c7e5512edc9bf0) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:55.042142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387b05a-b4ce-417f-8849-893bba0253f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.043621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387b05a-b4ce-417f-8849-893bba0253f4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.049978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 465/923] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/role_assignments?user.id=a9da3c101fd64bb496c7e5512edc9bf0&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=683c59f919e14e338161fe36d0f44320 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:55.051659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599cdd-cdfb-4bd7-8e3c-2fcef81573fe None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.052234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599cdd-cdfb-4bd7-8e3c-2fcef81573fe None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.052695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4599cdd-cdfb-4bd7-8e3c-2fcef81573fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.066577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.077218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a4599cdd-cdfb-4bd7-8e3c-2fcef81573fe None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:55.078865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a4599cdd-cdfb-4bd7-8e3c-2fcef81573fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:55.102427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.117866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe5198-ef69-4da5-8822-797ebf65b739 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.156728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0920871-3829-47eb-ad5a-125caaa973a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.157431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0920871-3829-47eb-ad5a-125caaa973a8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.157843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0920871-3829-47eb-ad5a-125caaa973a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.158127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0920871-3829-47eb-ad5a-125caaa973a8 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.159774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0920871-3829-47eb-ad5a-125caaa973a8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:55.159908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0920871-3829-47eb-ad5a-125caaa973a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.161333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0920871-3829-47eb-ad5a-125caaa973a8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.165369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 466/924] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:55.170986 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 459/925] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 21 04:05:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:55.180178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4599cdd-cdfb-4bd7-8e3c-2fcef81573fe None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.191642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0920871-3829-47eb-ad5a-125caaa973a8 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.296303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4599cdd-cdfb-4bd7-8e3c-2fcef81573fe None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.317952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0920871-3829-47eb-ad5a-125caaa973a8 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.340166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dbfe5-391b-44c5-9e93-36670db82aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.341200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dbfe5-391b-44c5-9e93-36670db82aad None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.341708 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dbfe5-391b-44c5-9e93-36670db82aad None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.342702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688dbfe5-391b-44c5-9e93-36670db82aad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.345697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dbfe5-391b-44c5-9e93-36670db82aad None admin] RBAC: Adding query filter params (interface=public, service_id=2e6d6320f0ab46f4b89f341034d7a8f4, region_id=RegionOne) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:55.346881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dbfe5-391b-44c5-9e93-36670db82aad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.349429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688dbfe5-391b-44c5-9e93-36670db82aad None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.355608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.362303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2e03b-5ab1-43c1-ae45-d060ad993691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.362303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e03b-5ab1-43c1-ae45-d060ad993691 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.362629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e03b-5ab1-43c1-ae45-d060ad993691 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.362821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 467/926] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/endpoints?service_id=2e6d6320f0ab46f4b89f341034d7a8f4&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:55.363160 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e03b-5ab1-43c1-ae45-d060ad993691 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.364168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2e03b-5ab1-43c1-ae45-d060ad993691 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.364735 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dbfe5-391b-44c5-9e93-36670db82aad None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.366249 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2e03b-5ab1-43c1-ae45-d060ad993691 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-28a2e03b-5ab1-43c1-ae45-d060ad993691 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:55.383137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:55.384239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 21 04:05:55.385065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:55.387027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 460/927] 10.222.0.48 () {56 vars in 1132 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:55.391079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2e03b-5ab1-43c1-ae45-d060ad993691 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.463618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.480920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688dbfe5-391b-44c5-9e93-36670db82aad None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.496930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2e03b-5ab1-43c1-ae45-d060ad993691 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.523233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8d3b-7458-482a-9b9a-9bdeee778c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.524090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8d3b-7458-482a-9b9a-9bdeee778c3c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.524476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8d3b-7458-482a-9b9a-9bdeee778c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.524849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf8d3b-7458-482a-9b9a-9bdeee778c3c None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.525747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf8d3b-7458-482a-9b9a-9bdeee778c3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.527380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf8d3b-7458-482a-9b9a-9bdeee778c3c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.543001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 468/928] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/services => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:05:55.543305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97ddee-4f68-4d31-a88d-8f2441c96ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.543305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97ddee-4f68-4d31-a88d-8f2441c96ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.543305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97ddee-4f68-4d31-a88d-8f2441c96ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.543305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97ddee-4f68-4d31-a88d-8f2441c96ba8 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.543834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97ddee-4f68-4d31-a88d-8f2441c96ba8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:55.543834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97ddee-4f68-4d31-a88d-8f2441c96ba8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.543834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97ddee-4f68-4d31-a88d-8f2441c96ba8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.550392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 461/929] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:55.556346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8d3b-7458-482a-9b9a-9bdeee778c3c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.649567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.670386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf8d3b-7458-482a-9b9a-9bdeee778c3c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.709034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec2d563-bcf3-43e3-847a-6efdc801f1ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.709709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2d563-bcf3-43e3-847a-6efdc801f1ae None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.709996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2d563-bcf3-43e3-847a-6efdc801f1ae None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.710278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec2d563-bcf3-43e3-847a-6efdc801f1ae None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.711025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2d563-bcf3-43e3-847a-6efdc801f1ae None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:55.711342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2d563-bcf3-43e3-847a-6efdc801f1ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.712741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec2d563-bcf3-43e3-847a-6efdc801f1ae None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.718508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 469/930] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:05:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:55.724561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97ddee-4f68-4d31-a88d-8f2441c96ba8 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:55.788080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:55.832235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97ddee-4f68-4d31-a88d-8f2441c96ba8 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:55.867890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa80a5d-bc49-4909-8b0d-00ea92ee9fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:55.868550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa80a5d-bc49-4909-8b0d-00ea92ee9fa6 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:55.868831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa80a5d-bc49-4909-8b0d-00ea92ee9fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:55.869107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa80a5d-bc49-4909-8b0d-00ea92ee9fa6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:55.869855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa80a5d-bc49-4909-8b0d-00ea92ee9fa6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:55.871254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa80a5d-bc49-4909-8b0d-00ea92ee9fa6 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:55.894829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 462/931] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 21 04:05:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:56.055803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91208b17-1747-416b-80f7-f83a7b2476b1 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.056132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91208b17-1747-416b-80f7-f83a7b2476b1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.056364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91208b17-1747-416b-80f7-f83a7b2476b1 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.057852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 470/932] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:56.063200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c14ad-5807-470f-b53e-360aa7476620 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.063714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c14ad-5807-470f-b53e-360aa7476620 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.064208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9c14ad-5807-470f-b53e-360aa7476620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.083112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-4d9c14ad-5807-470f-b53e-360aa7476620 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:56.084321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4d9c14ad-5807-470f-b53e-360aa7476620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:56.162217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 463/933] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:05:56.186296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91208b17-1747-416b-80f7-f83a7b2476b1 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:56.303936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91208b17-1747-416b-80f7-f83a7b2476b1 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:56.339510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:56.340087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.340372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.340650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.341350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:56.342811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:56.344218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: WARNING keystone.server.flask.common [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 04:05:56.364500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.sql.core [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 04:05:56.364500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 04:05:56.364500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [parameters: {'id': '37f927e192c7474290183a4cf2b66670', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 04:05:56.364500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80605) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37f927e192c7474290183a4cf2b66670.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37f927e192c7474290183a4cf2b66670. Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:05:56.381749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application result.read() Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 21 04:05:56.382570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application yield resource Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise self.value Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application session.commit() Jul 21 04:05:56.383570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self.session.flush() Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application compat.raise_( Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 04:05:56.384460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 04:05:56.385423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application result.read() Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:05:56.386211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [parameters: {'id': '37f927e192c7474290183a4cf2b66670', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:56.388292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:56.390186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:56.392440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:56.392440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 21 04:05:56.392440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 21 04:05:56.392440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:56.392440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:56.392440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 21 04:05:56.392440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 21 04:05:56.392440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 37f927e192c7474290183a4cf2b66670. Jul 21 04:05:56.392440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:56.392440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 471/934] 10.222.0.48 () {60 vars in 1140 bytes} [Thu Jul 21 04:05:56 2022] POST /identity/v3/projects => generated 262 bytes in 198 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:56.399424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c14ad-5807-470f-b53e-360aa7476620 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:56.451074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:56.516803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9c14ad-5807-470f-b53e-360aa7476620 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:56.552723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb362a-3b8a-42d6-b3d8-0a118d4472da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:56.553867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb362a-3b8a-42d6-b3d8-0a118d4472da None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.554347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb362a-3b8a-42d6-b3d8-0a118d4472da None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.554828 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb362a-3b8a-42d6-b3d8-0a118d4472da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.561913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb362a-3b8a-42d6-b3d8-0a118d4472da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:56.563612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb362a-3b8a-42d6-b3d8-0a118d4472da None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0eeb362a-3b8a-42d6-b3d8-0a118d4472da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:56.577961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:56.578851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:56.579923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:56.579923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:56.579923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:56.579923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:56.579923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:56.579923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:56.579923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:56.579923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:56.582942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 464/935] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:56.589320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:56.595453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:56.705564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a4f846-3ff8-41e8-902a-6eda092f70ae None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:56.742222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0cf33-df9f-4ca7-a607-175389e61e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:56.743294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0cf33-df9f-4ca7-a607-175389e61e1c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:56.743806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0cf33-df9f-4ca7-a607-175389e61e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:56.744283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0cf33-df9f-4ca7-a607-175389e61e1c None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:56.745257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0cf33-df9f-4ca7-a607-175389e61e1c None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:56.745862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0cf33-df9f-4ca7-a607-175389e61e1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:56.747773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f0cf33-df9f-4ca7-a607-175389e61e1c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:56.769177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 472/936] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:57.258032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6b511-7d8a-4949-bc40-135888defc81 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.258572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6b511-7d8a-4949-bc40-135888defc81 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.258572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6b511-7d8a-4949-bc40-135888defc81 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.260314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 465/937] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:57.265682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b43b-bc81-4667-a1ef-52bd61d6825a None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.266089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b43b-bc81-4667-a1ef-52bd61d6825a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.266260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b43b-bc81-4667-a1ef-52bd61d6825a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.284690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-9510b43b-bc81-4667-a1ef-52bd61d6825a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:57.286412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9510b43b-bc81-4667-a1ef-52bd61d6825a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:57.349410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:57.362870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 473/938] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:57.385883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6b511-7d8a-4949-bc40-135888defc81 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.494455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa6b511-7d8a-4949-bc40-135888defc81 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.496024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:57.531483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc6e6bc-38fa-4759-a97c-77256b0b6e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.532300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6e6bc-38fa-4759-a97c-77256b0b6e7c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.532628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6e6bc-38fa-4759-a97c-77256b0b6e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.532907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6e6bc-38fa-4759-a97c-77256b0b6e7c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.544800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc6e6bc-38fa-4759-a97c-77256b0b6e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-2dc6e6bc-38fa-4759-a97c-77256b0b6e7c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:05:57.554102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:57.555085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:05:57.555943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:57.560328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 466/939] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:57.564060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b43b-bc81-4667-a1ef-52bd61d6825a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.633975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58cb9-99e9-4560-9625-999b260cce9e None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.634317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58cb9-99e9-4560-9625-999b260cce9e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.634524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf58cb9-99e9-4560-9625-999b260cce9e None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.636233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 467/940] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:05:57.641142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0a755-b5eb-4d55-b8d1-54eb6e5f5b88 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.641414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0a755-b5eb-4d55-b8d1-54eb6e5f5b88 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.641699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d0a755-b5eb-4d55-b8d1-54eb6e5f5b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.658640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-04d0a755-b5eb-4d55-b8d1-54eb6e5f5b88 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:57.659961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-04d0a755-b5eb-4d55-b8d1-54eb6e5f5b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:57.667671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b43b-bc81-4667-a1ef-52bd61d6825a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.704838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a346-6670-409f-a34c-eca508b49ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.705557 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a346-6670-409f-a34c-eca508b49ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.705834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a346-6670-409f-a34c-eca508b49ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.706109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272a346-6670-409f-a34c-eca508b49ee8 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.706867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a346-6670-409f-a34c-eca508b49ee8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:57.707232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a346-6670-409f-a34c-eca508b49ee8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:57.708609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272a346-6670-409f-a34c-eca508b49ee8 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:57.717382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 474/941] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:57.723462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a346-6670-409f-a34c-eca508b49ee8 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.736097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 468/942] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:05:57.759629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0a755-b5eb-4d55-b8d1-54eb6e5f5b88 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.791636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:57.843776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272a346-6670-409f-a34c-eca508b49ee8 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.883138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1326f-f9aa-44e5-88f3-f234f14c59ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.883931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1326f-f9aa-44e5-88f3-f234f14c59ae None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.884213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1326f-f9aa-44e5-88f3-f234f14c59ae None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.884487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1326f-f9aa-44e5-88f3-f234f14c59ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.888087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:57.897018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1326f-f9aa-44e5-88f3-f234f14c59ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:57.898689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1326f-f9aa-44e5-88f3-f234f14c59ae None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:57.900740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d0a755-b5eb-4d55-b8d1-54eb6e5f5b88 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-42d1326f-f9aa-44e5-88f3-f234f14c59ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:57.917722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:57.918726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:57.919736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:57.919736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:57.919736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:57.919736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:57.919736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 475/943] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:57.924974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1326f-f9aa-44e5-88f3-f234f14c59ae None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:57.946477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65c7a7-0388-4345-8428-9449b72161ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:57.947764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65c7a7-0388-4345-8428-9449b72161ef None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:57.948283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65c7a7-0388-4345-8428-9449b72161ef None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:57.948806 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65c7a7-0388-4345-8428-9449b72161ef None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:57.949668 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65c7a7-0388-4345-8428-9449b72161ef None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:57.951346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65c7a7-0388-4345-8428-9449b72161ef None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0d65c7a7-0388-4345-8428-9449b72161ef None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:57.964892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:57.965895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:05:57.966755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:57.969715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 469/944] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:57.978268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65c7a7-0388-4345-8428-9449b72161ef None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.037350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1326f-f9aa-44e5-88f3-f234f14c59ae None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.044644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.075713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63716d-3d36-427c-b492-5ac1f0e39d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.076541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63716d-3d36-427c-b492-5ac1f0e39d68 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.076919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63716d-3d36-427c-b492-5ac1f0e39d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.077298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63716d-3d36-427c-b492-5ac1f0e39d68 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.078243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63716d-3d36-427c-b492-5ac1f0e39d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:58.078738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63716d-3d36-427c-b492-5ac1f0e39d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.080261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63716d-3d36-427c-b492-5ac1f0e39d68 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.085695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65c7a7-0388-4345-8428-9449b72161ef None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.097165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 476/945] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:58.104278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63716d-3d36-427c-b492-5ac1f0e39d68 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.125277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9493dde2-9914-47eb-a707-75c84db0f55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.125941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493dde2-9914-47eb-a707-75c84db0f55e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.126219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493dde2-9914-47eb-a707-75c84db0f55e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.126546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9493dde2-9914-47eb-a707-75c84db0f55e None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.127556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493dde2-9914-47eb-a707-75c84db0f55e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:58.127866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493dde2-9914-47eb-a707-75c84db0f55e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.129354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9493dde2-9914-47eb-a707-75c84db0f55e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.134409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 470/946] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 21 04:05:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:58.138278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955140d-3714-41af-931e-dcbdcd0dbb0f None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.138278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955140d-3714-41af-931e-dcbdcd0dbb0f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.138278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955140d-3714-41af-931e-dcbdcd0dbb0f None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.138278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 471/947] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:58.141713 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955140d-3714-41af-931e-dcbdcd0dbb0f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.165065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.231376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63716d-3d36-427c-b492-5ac1f0e39d68 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.259566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955140d-3714-41af-931e-dcbdcd0dbb0f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.266828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd837f-5a21-43b6-a285-b0b7f80b2e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.268343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd837f-5a21-43b6-a285-b0b7f80b2e70 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.268706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd837f-5a21-43b6-a285-b0b7f80b2e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.269188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd837f-5a21-43b6-a285-b0b7f80b2e70 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.277472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd837f-5a21-43b6-a285-b0b7f80b2e70 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.278926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd837f-5a21-43b6-a285-b0b7f80b2e70 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-d2cd837f-5a21-43b6-a285-b0b7f80b2e70 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:58.294374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:58.295508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 477/948] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa5948-8b39-420a-9a07-da0ebd83665c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.301694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa5948-8b39-420a-9a07-da0ebd83665c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.302461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa5948-8b39-420a-9a07-da0ebd83665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.302541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038c298-862a-44f4-af5b-75fe4a47e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.302541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038c298-862a-44f4-af5b-75fe4a47e224 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.302541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038c298-862a-44f4-af5b-75fe4a47e224 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.302541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e038c298-862a-44f4-af5b-75fe4a47e224 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.303593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038c298-862a-44f4-af5b-75fe4a47e224 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:58.303958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038c298-862a-44f4-af5b-75fe4a47e224 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.305404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e038c298-862a-44f4-af5b-75fe4a47e224 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.311142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 472/949] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:58.316274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038c298-862a-44f4-af5b-75fe4a47e224 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.318369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-00fa5948-8b39-420a-9a07-da0ebd83665c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:58.320360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-00fa5948-8b39-420a-9a07-da0ebd83665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:58.342146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.392476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 478/950] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:58.393973 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa5948-8b39-420a-9a07-da0ebd83665c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.405593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.425081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e038c298-862a-44f4-af5b-75fe4a47e224 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.463169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d88a3-fa95-49d2-a719-7e06f424d24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.463850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d88a3-fa95-49d2-a719-7e06f424d24f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.464131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d88a3-fa95-49d2-a719-7e06f424d24f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.464405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d88a3-fa95-49d2-a719-7e06f424d24f None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.465241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d88a3-fa95-49d2-a719-7e06f424d24f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:58.465547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d88a3-fa95-49d2-a719-7e06f424d24f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.466990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5d88a3-fa95-49d2-a719-7e06f424d24f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.485625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 473/951] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:58.486354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d88a3-fa95-49d2-a719-7e06f424d24f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.523329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa5948-8b39-420a-9a07-da0ebd83665c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.558392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8993a-797b-4dfc-99f7-0e354d54cc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.558978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8993a-797b-4dfc-99f7-0e354d54cc78 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.559277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8993a-797b-4dfc-99f7-0e354d54cc78 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.559556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8993a-797b-4dfc-99f7-0e354d54cc78 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.560298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8993a-797b-4dfc-99f7-0e354d54cc78 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.561680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8993a-797b-4dfc-99f7-0e354d54cc78 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.581660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 479/952] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 21 04:05:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:05:58.592035 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8993a-797b-4dfc-99f7-0e354d54cc78 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.592442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d88a3-fa95-49d2-a719-7e06f424d24f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.616118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.647081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0435ff-60e7-4063-81a9-b815fd5606e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.648164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0435ff-60e7-4063-81a9-b815fd5606e7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.648514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0435ff-60e7-4063-81a9-b815fd5606e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.648858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0435ff-60e7-4063-81a9-b815fd5606e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.650148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0435ff-60e7-4063-81a9-b815fd5606e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.651236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0435ff-60e7-4063-81a9-b815fd5606e7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-fd0435ff-60e7-4063-81a9-b815fd5606e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:58.665036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:58.666148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:05:58.667028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:58.671575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 474/953] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:58.672714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0435ff-60e7-4063-81a9-b815fd5606e7 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.676788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.745750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8993a-797b-4dfc-99f7-0e354d54cc78 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.790861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d22707-4272-4898-b446-7d8c5a312b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.791713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d22707-4272-4898-b446-7d8c5a312b46 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.791994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d22707-4272-4898-b446-7d8c5a312b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.792270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d22707-4272-4898-b446-7d8c5a312b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.804335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d22707-4272-4898-b446-7d8c5a312b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.805912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d22707-4272-4898-b446-7d8c5a312b46 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.809463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0435ff-60e7-4063-81a9-b815fd5606e7 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-28d22707-4272-4898-b446-7d8c5a312b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:05:58.827243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:58.828312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:58.829257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:05:58.829257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:05:58.829257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:05:58.829257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:58.829257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 480/954] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:58.834984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d22707-4272-4898-b446-7d8c5a312b46 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.854547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3c17c-7272-4a65-939a-feadbeb74139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:58.855398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c17c-7272-4a65-939a-feadbeb74139 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:58.855686 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c17c-7272-4a65-939a-feadbeb74139 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:58.856224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3c17c-7272-4a65-939a-feadbeb74139 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:58.857441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3c17c-7272-4a65-939a-feadbeb74139 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:58.857777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3c17c-7272-4a65-939a-feadbeb74139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:58.859272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a3c17c-7272-4a65-939a-feadbeb74139 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:58.866411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 475/955] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:05:58.871865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3c17c-7272-4a65-939a-feadbeb74139 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:58.915405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.949411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:58.964781 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d22707-4272-4898-b446-7d8c5a312b46 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:58.990573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3c17c-7272-4a65-939a-feadbeb74139 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.001864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83ff09f-dfe0-472c-a5a2-7bd91a76e428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.003425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ff09f-dfe0-472c-a5a2-7bd91a76e428 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.003747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ff09f-dfe0-472c-a5a2-7bd91a76e428 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.004026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83ff09f-dfe0-472c-a5a2-7bd91a76e428 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.004918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ff09f-dfe0-472c-a5a2-7bd91a76e428 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:59.005661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ff09f-dfe0-472c-a5a2-7bd91a76e428 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.007345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83ff09f-dfe0-472c-a5a2-7bd91a76e428 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.024627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 481/956] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:59.025996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727490-af33-4746-902b-f181181e7987 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.026282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727490-af33-4746-902b-f181181e7987 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.026555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79727490-af33-4746-902b-f181181e7987 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.027927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 482/957] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:05:59.030829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ef3a0-2c68-4c58-a8d6-0ba9dbe1f0a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.031598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ef3a0-2c68-4c58-a8d6-0ba9dbe1f0a5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.031891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ef3a0-2c68-4c58-a8d6-0ba9dbe1f0a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.032171 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ef3a0-2c68-4c58-a8d6-0ba9dbe1f0a5 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.032439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727490-af33-4746-902b-f181181e7987 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.032895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ef3a0-2c68-4c58-a8d6-0ba9dbe1f0a5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:59.033253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ef3a0-2c68-4c58-a8d6-0ba9dbe1f0a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.035215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ef3a0-2c68-4c58-a8d6-0ba9dbe1f0a5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.047554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 476/958] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:05:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:59.047554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff075-6c3b-4c8c-ab22-27261763396a None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.047554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff075-6c3b-4c8c-ab22-27261763396a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.047554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff075-6c3b-4c8c-ab22-27261763396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.067584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-121ff075-6c3b-4c8c-ab22-27261763396a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:05:59.069176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-121ff075-6c3b-4c8c-ab22-27261763396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:05:59.164267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 477/959] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:05:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:05:59.172136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79727490-af33-4746-902b-f181181e7987 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.195229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff075-6c3b-4c8c-ab22-27261763396a None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.206986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:59.219871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5055aa-281b-4242-b140-1ac03a7df36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.221522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5055aa-281b-4242-b140-1ac03a7df36b None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.222444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5055aa-281b-4242-b140-1ac03a7df36b None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.222730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5055aa-281b-4242-b140-1ac03a7df36b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.231523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5055aa-281b-4242-b140-1ac03a7df36b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.232995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5055aa-281b-4242-b140-1ac03a7df36b None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-9c5055aa-281b-4242-b140-1ac03a7df36b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:05:59.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:59.250710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:59.252023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:05:59.252023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:05:59.252023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:05:59.252023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:05:59.252023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:05:59.252023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:05:59.252023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:05:59.252023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:05:59.252023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 483/960] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:05:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:59.259499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5055aa-281b-4242-b140-1ac03a7df36b None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.280954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:59.332419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff075-6c3b-4c8c-ab22-27261763396a None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.379790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5055aa-281b-4242-b140-1ac03a7df36b None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.381113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.381867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.382221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.382822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.384588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.386236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.387656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WARNING keystone.server.flask.common [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 21 04:05:59.405502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.sql.core [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 04:05:59.405502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 04:05:59.405502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [parameters: {'user_id': '969cdc4abe0b4a189f3ff72f231687da', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 04:05:59.405502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80606) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application result.read() Jul 21 04:05:59.416293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:05:59.417247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application yield resource Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application next(self.gen) Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self.session.rollback() Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self.force_reraise() Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise self.value Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application session.commit() Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 21 04:05:59.418299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._prepare_impl() Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self.session.flush() Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._flush(objects) Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application compat.raise_( Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application flush_context.execute() Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rec.execute(self) Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 21 04:05:59.419250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 21 04:05:59.420917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application result = self._query(query) Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application conn.query(q) Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application result.read() Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 21 04:05:59.421797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [parameters: {'user_id': '969cdc4abe0b4a189f3ff72f231687da', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:59.422656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 21 04:05:59.423520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 21 04:05:59.426102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 21 04:05:59.426102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 21 04:05:59.426102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 21 04:05:59.426102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 21 04:05:59.426102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 21 04:05:59.426102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:59.426102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 478/961] 10.222.0.48 () {60 vars in 1131 bytes} [Thu Jul 21 04:05:59 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:05:59.426102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.429416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f9a41-33a5-4f08-8058-4c5ce261cbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.430429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f9a41-33a5-4f08-8058-4c5ce261cbec None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.430714 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f9a41-33a5-4f08-8058-4c5ce261cbec None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.431028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f9a41-33a5-4f08-8058-4c5ce261cbec None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.432978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f9a41-33a5-4f08-8058-4c5ce261cbec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:59.433297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f9a41-33a5-4f08-8058-4c5ce261cbec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.434826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f9a41-33a5-4f08-8058-4c5ce261cbec None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.452405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 484/962] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:05:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:05:59.458723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f9a41-33a5-4f08-8058-4c5ce261cbec None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.507623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:59.552678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f93c74e-1e9f-415a-8a9b-b9f777ab4417 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.563412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f9a41-33a5-4f08-8058-4c5ce261cbec None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.583513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:59.600789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e93a58-0f8d-4cdc-be77-3f78ba7ba441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.601592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e93a58-0f8d-4cdc-be77-3f78ba7ba441 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.601874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e93a58-0f8d-4cdc-be77-3f78ba7ba441 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.602147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e93a58-0f8d-4cdc-be77-3f78ba7ba441 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.605694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e55eb-2665-4b41-992b-b050fcabbfa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.606578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e55eb-2665-4b41-992b-b050fcabbfa6 None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.606856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e55eb-2665-4b41-992b-b050fcabbfa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.607174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e55eb-2665-4b41-992b-b050fcabbfa6 None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/a9da3c101fd64bb496c7e5512edc9bf0/roles/683c59f919e14e338161fe36d0f44320` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.609439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e55eb-2665-4b41-992b-b050fcabbfa6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=a9da3c101fd64bb496c7e5512edc9bf0, role_id=683c59f919e14e338161fe36d0f44320)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.610873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e55eb-2665-4b41-992b-b050fcabbfa6 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.613662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e93a58-0f8d-4cdc-be77-3f78ba7ba441 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.616352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e93a58-0f8d-4cdc-be77-3f78ba7ba441 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-e4e93a58-0f8d-4cdc-be77-3f78ba7ba441 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:05:59.634854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:05:59.635954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:05:59.636907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:05:59.636907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:05:59.636907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:05:59.636907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:05:59.636907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:05:59.636907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:05:59.636907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:05:59.636907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:05:59.636907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 21 04:05:59.636907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:05:59.637477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 485/963] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:05:59 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/a9da3c101fd64bb496c7e5512edc9bf0/roles/683c59f919e14e338161fe36d0f44320 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:05:59.639873 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 479/964] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:05:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:05:59.646243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e55eb-2665-4b41-992b-b050fcabbfa6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:05:59.765572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e55eb-2665-4b41-992b-b050fcabbfa6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:05:59.775369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:05:59.808665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cb8841-e450-4d66-a141-17f4b68a8512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:05:59.809363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8841-e450-4d66-a141-17f4b68a8512 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:05:59.809649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8841-e450-4d66-a141-17f4b68a8512 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:05:59.809928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cb8841-e450-4d66-a141-17f4b68a8512 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:05:59.810833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb8841-e450-4d66-a141-17f4b68a8512 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:05:59.811173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb8841-e450-4d66-a141-17f4b68a8512 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:05:59.812690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cb8841-e450-4d66-a141-17f4b68a8512 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:05:59.852573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 486/965] 10.222.0.48 () {56 vars in 1101 bytes} [Thu Jul 21 04:05:59 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:00.757101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41620d54-3ed1-4299-8147-d5108dbbb0fa None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.757620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41620d54-3ed1-4299-8147-d5108dbbb0fa None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.757699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41620d54-3ed1-4299-8147-d5108dbbb0fa None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.761982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 480/966] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:00.768438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23386d14-bcc9-424f-b124-a6446343461d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:00.768957 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23386d14-bcc9-424f-b124-a6446343461d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:00.769148 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23386d14-bcc9-424f-b124-a6446343461d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:00.787216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-23386d14-bcc9-424f-b124-a6446343461d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:00.788419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-23386d14-bcc9-424f-b124-a6446343461d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:00.859296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 487/967] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:00.882009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41620d54-3ed1-4299-8147-d5108dbbb0fa None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:00.988951 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41620d54-3ed1-4299-8147-d5108dbbb0fa None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.021600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72db431-334d-4753-bf1f-5cfe1028bad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.022333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72db431-334d-4753-bf1f-5cfe1028bad4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.022620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72db431-334d-4753-bf1f-5cfe1028bad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.022900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72db431-334d-4753-bf1f-5cfe1028bad4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.023584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72db431-334d-4753-bf1f-5cfe1028bad4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.025247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72db431-334d-4753-bf1f-5cfe1028bad4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f72db431-334d-4753-bf1f-5cfe1028bad4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:01.038104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:01.039452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:01.040316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:01.043272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 481/968] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:01.045224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23386d14-bcc9-424f-b124-a6446343461d None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.139518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.150324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23386d14-bcc9-424f-b124-a6446343461d None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.163804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97350fc9-b62e-4b22-afdf-0137cb53ea7f None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.164144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97350fc9-b62e-4b22-afdf-0137cb53ea7f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.164391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97350fc9-b62e-4b22-afdf-0137cb53ea7f None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.165776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 482/969] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:01.170578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6940a99-27ec-4c61-852f-c89caa2a3b46 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.170864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6940a99-27ec-4c61-852f-c89caa2a3b46 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.171168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6940a99-27ec-4c61-852f-c89caa2a3b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.188641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d6940a99-27ec-4c61-852f-c89caa2a3b46 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:01.190127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d6940a99-27ec-4c61-852f-c89caa2a3b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:01.192741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c196e-ad6c-4292-9613-b252c420d28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.194265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c196e-ad6c-4292-9613-b252c420d28e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.194618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c196e-ad6c-4292-9613-b252c420d28e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.194987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c196e-ad6c-4292-9613-b252c420d28e None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.195807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c196e-ad6c-4292-9613-b252c420d28e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:01.196185 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c196e-ad6c-4292-9613-b252c420d28e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.197644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c196e-ad6c-4292-9613-b252c420d28e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.204944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 488/970] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:01.210236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c196e-ad6c-4292-9613-b252c420d28e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.239108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.266675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 483/971] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:01.289598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6940a99-27ec-4c61-852f-c89caa2a3b46 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.326196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c196e-ad6c-4292-9613-b252c420d28e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.366507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429895-a21b-42f9-9462-dc95dd9d28c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.367447 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429895-a21b-42f9-9462-dc95dd9d28c7 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.367876 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429895-a21b-42f9-9462-dc95dd9d28c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.368819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79429895-a21b-42f9-9462-dc95dd9d28c7 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.369679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79429895-a21b-42f9-9462-dc95dd9d28c7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:01.370177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79429895-a21b-42f9-9462-dc95dd9d28c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.371910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79429895-a21b-42f9-9462-dc95dd9d28c7 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.378201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 489/972] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:01.384236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429895-a21b-42f9-9462-dc95dd9d28c7 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.398137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6940a99-27ec-4c61-852f-c89caa2a3b46 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.407369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.434877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a860d-1677-44a1-a137-25bc8248222e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.435566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a860d-1677-44a1-a137-25bc8248222e None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.436126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a860d-1677-44a1-a137-25bc8248222e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.436126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a860d-1677-44a1-a137-25bc8248222e None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.436833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a860d-1677-44a1-a137-25bc8248222e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.438201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a860d-1677-44a1-a137-25bc8248222e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.454175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 484/973] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:01 2022] POST /identity/v3/services => generated 242 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:06:01.498539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79429895-a21b-42f9-9462-dc95dd9d28c7 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.545556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46097430-c77b-4aa6-b7ec-5605dd65e796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.546517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46097430-c77b-4aa6-b7ec-5605dd65e796 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.546975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46097430-c77b-4aa6-b7ec-5605dd65e796 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.547420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46097430-c77b-4aa6-b7ec-5605dd65e796 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.548401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46097430-c77b-4aa6-b7ec-5605dd65e796 None admin] RBAC: Adding query filter params (interface=admin, service_id=2e6d6320f0ab46f4b89f341034d7a8f4, region_id=RegionOne) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:01.549397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46097430-c77b-4aa6-b7ec-5605dd65e796 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.551321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46097430-c77b-4aa6-b7ec-5605dd65e796 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.557602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 490/974] 10.222.0.48 () {56 vars in 1249 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/endpoints?service_id=2e6d6320f0ab46f4b89f341034d7a8f4&interface=admin®ion_id=RegionOne => generated 193 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:01.563790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a860d-1677-44a1-a137-25bc8248222e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.603110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.675318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a860d-1677-44a1-a137-25bc8248222e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.703145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533db0b-a6ee-40e3-81e9-cbe60d419447 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.703441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533db0b-a6ee-40e3-81e9-cbe60d419447 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.703723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0533db0b-a6ee-40e3-81e9-cbe60d419447 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.705814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 491/975] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:01.710944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813efb5e-9012-4631-bbec-63729e604a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.711132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721926-81ec-4178-ad88-0d54e0303191 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.711243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721926-81ec-4178-ad88-0d54e0303191 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.711526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa721926-81ec-4178-ad88-0d54e0303191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.711889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813efb5e-9012-4631-bbec-63729e604a42 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.712240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813efb5e-9012-4631-bbec-63729e604a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.712586 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813efb5e-9012-4631-bbec-63729e604a42 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.713595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813efb5e-9012-4631-bbec-63729e604a42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:01.715062 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813efb5e-9012-4631-bbec-63729e604a42 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:01.722864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 485/976] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:06:01.729152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-aa721926-81ec-4178-ad88-0d54e0303191 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:01.730403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-aa721926-81ec-4178-ad88-0d54e0303191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:01.805588 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 492/977] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:01.829746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813efb5e-9012-4631-bbec-63729e604a42 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:01.936471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:01.939682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813efb5e-9012-4631-bbec-63729e604a42 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:01.975651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef87cd-c3d4-4c00-b7e3-d538302a12e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:01.976514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef87cd-c3d4-4c00-b7e3-d538302a12e6 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:01.976798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef87cd-c3d4-4c00-b7e3-d538302a12e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:01.977070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef87cd-c3d4-4c00-b7e3-d538302a12e6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:01.988261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef87cd-c3d4-4c00-b7e3-d538302a12e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-2cef87cd-c3d4-4c00-b7e3-d538302a12e6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:01.996584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:01.997505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:01.998362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 486/978] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 21 04:06:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:02.005938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa721926-81ec-4178-ad88-0d54e0303191 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.019264 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.109662 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa721926-81ec-4178-ad88-0d54e0303191 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.144157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d35a-ca82-416e-9ec5-1d50e2755d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.144824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d35a-ca82-416e-9ec5-1d50e2755d21 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.145108 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d35a-ca82-416e-9ec5-1d50e2755d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.145387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9d35a-ca82-416e-9ec5-1d50e2755d21 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.146136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d35a-ca82-416e-9ec5-1d50e2755d21 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:02.146448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d35a-ca82-416e-9ec5-1d50e2755d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.148023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9d35a-ca82-416e-9ec5-1d50e2755d21 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.161523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 493/979] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:02.162797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef87cd-c3d4-4c00-b7e3-d538302a12e6 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.277228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef87cd-c3d4-4c00-b7e3-d538302a12e6 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.311369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473a371-ce26-42d0-bc32-76995d3e3ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.312154 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a371-ce26-42d0-bc32-76995d3e3ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.312435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a371-ce26-42d0-bc32-76995d3e3ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.312708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f473a371-ce26-42d0-bc32-76995d3e3ad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.323705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473a371-ce26-42d0-bc32-76995d3e3ad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.325161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f473a371-ce26-42d0-bc32-76995d3e3ad3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f473a371-ce26-42d0-bc32-76995d3e3ad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:02.343105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:02.344083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:02.344976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:02.344976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:02.344976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:02.344976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:02.344976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 487/980] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:02.351526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d35a-ca82-416e-9ec5-1d50e2755d21 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.422195 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.453847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9d35a-ca82-416e-9ec5-1d50e2755d21 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.487402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5da60-79f7-4b00-af86-d1f3774ec43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.488052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5da60-79f7-4b00-af86-d1f3774ec43a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.488332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5da60-79f7-4b00-af86-d1f3774ec43a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.488606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5da60-79f7-4b00-af86-d1f3774ec43a None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.489323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5da60-79f7-4b00-af86-d1f3774ec43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:02.489629 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5da60-79f7-4b00-af86-d1f3774ec43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.491131 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5da60-79f7-4b00-af86-d1f3774ec43a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.507917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 494/981] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:02.509168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473a371-ce26-42d0-bc32-76995d3e3ad3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.525463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.614611 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f473a371-ce26-42d0-bc32-76995d3e3ad3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.649745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fefcba-2066-405a-a4db-940b9705bc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.650545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fefcba-2066-405a-a4db-940b9705bc4f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.650830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fefcba-2066-405a-a4db-940b9705bc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.651131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fefcba-2066-405a-a4db-940b9705bc4f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.658575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fefcba-2066-405a-a4db-940b9705bc4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.660048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fefcba-2066-405a-a4db-940b9705bc4f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-d4fefcba-2066-405a-a4db-940b9705bc4f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:02.674356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:02.675351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:02.676386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 488/982] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:02.684682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5da60-79f7-4b00-af86-d1f3774ec43a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.785530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5da60-79f7-4b00-af86-d1f3774ec43a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.815926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.822587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80880a28-5e70-459a-810e-117415d4470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.823619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80880a28-5e70-459a-810e-117415d4470d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.823902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80880a28-5e70-459a-810e-117415d4470d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.824182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80880a28-5e70-459a-810e-117415d4470d None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:02.825005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80880a28-5e70-459a-810e-117415d4470d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:02.825315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80880a28-5e70-459a-810e-117415d4470d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:02.826746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80880a28-5e70-459a-810e-117415d4470d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:02.850250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 495/983] 10.222.0.48 () {56 vars in 1149 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:02.852165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fefcba-2066-405a-a4db-940b9705bc4f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:02.928122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:02.959897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fefcba-2066-405a-a4db-940b9705bc4f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:02.993812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7fe86-0f1a-433c-a86a-91f0211ff0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:02.994457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7fe86-0f1a-433c-a86a-91f0211ff0df None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:02.994740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7fe86-0f1a-433c-a86a-91f0211ff0df None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:02.995038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d7fe86-0f1a-433c-a86a-91f0211ff0df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.061735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7fe86-0f1a-433c-a86a-91f0211ff0df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.063216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d7fe86-0f1a-433c-a86a-91f0211ff0df None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.131395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.167128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 489/984] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:02 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:03.169199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80880a28-5e70-459a-810e-117415d4470d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.276236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80880a28-5e70-459a-810e-117415d4470d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.309217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973adf65-1ac0-46b2-9173-2a40e69b9792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.310011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973adf65-1ac0-46b2-9173-2a40e69b9792 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.310289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973adf65-1ac0-46b2-9173-2a40e69b9792 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.310558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973adf65-1ac0-46b2-9173-2a40e69b9792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.321182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973adf65-1ac0-46b2-9173-2a40e69b9792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.322638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973adf65-1ac0-46b2-9173-2a40e69b9792 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-973adf65-1ac0-46b2-9173-2a40e69b9792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:03.340693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:03.341726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:03.342652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:03.342652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:03.342652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:03.342652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:03.342652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 496/985] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:03.347500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7fe86-0f1a-433c-a86a-91f0211ff0df None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.449148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d7fe86-0f1a-433c-a86a-91f0211ff0df None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.482864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3d4ad-acdf-4dff-a937-58f32eb28a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.483552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3d4ad-acdf-4dff-a937-58f32eb28a81 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.483835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3d4ad-acdf-4dff-a937-58f32eb28a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.484111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3d4ad-acdf-4dff-a937-58f32eb28a81 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.484824 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3d4ad-acdf-4dff-a937-58f32eb28a81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:03.485130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3d4ad-acdf-4dff-a937-58f32eb28a81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.487076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3d4ad-acdf-4dff-a937-58f32eb28a81 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.499056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 490/986] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:03.505219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973adf65-1ac0-46b2-9173-2a40e69b9792 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.543479 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6cefa-920e-4f5f-9eee-5d268983d198 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.543805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6cefa-920e-4f5f-9eee-5d268983d198 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.544037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6cefa-920e-4f5f-9eee-5d268983d198 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.545543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 491/987] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:03.548434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.551084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9948b-e325-4b66-a93f-381c152f053e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.551407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9948b-e325-4b66-a93f-381c152f053e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.551686 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9948b-e325-4b66-a93f-381c152f053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.569142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c9d9948b-e325-4b66-a93f-381c152f053e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:03.570549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c9d9948b-e325-4b66-a93f-381c152f053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:03.597458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.608805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973adf65-1ac0-46b2-9173-2a40e69b9792 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.641615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 492/988] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:03.643663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c08619-322c-4f50-9d28-86113e4a077a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.644453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08619-322c-4f50-9d28-86113e4a077a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.644737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08619-322c-4f50-9d28-86113e4a077a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.645012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c08619-322c-4f50-9d28-86113e4a077a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.651930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c08619-322c-4f50-9d28-86113e4a077a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.653474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c08619-322c-4f50-9d28-86113e4a077a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.665028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9948b-e325-4b66-a93f-381c152f053e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-63c08619-322c-4f50-9d28-86113e4a077a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:03.668010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:03.668920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:03.669857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:03.669857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:03.669857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:03.669857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:03.669857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:03.669857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:03.669857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:03.669857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:03.669857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 497/989] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:03.674862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c08619-322c-4f50-9d28-86113e4a077a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.779134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9948b-e325-4b66-a93f-381c152f053e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.780105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c08619-322c-4f50-9d28-86113e4a077a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.782422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.816106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b7099-26b6-42b2-bca6-402a0bad984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.816772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29353e3a-344b-4843-84b7-c1ca43bccc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.816895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b7099-26b6-42b2-bca6-402a0bad984f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.817038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b7099-26b6-42b2-bca6-402a0bad984f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.817312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b7099-26b6-42b2-bca6-402a0bad984f None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.817402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29353e3a-344b-4843-84b7-c1ca43bccc5d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.817639 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29353e3a-344b-4843-84b7-c1ca43bccc5d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.817914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29353e3a-344b-4843-84b7-c1ca43bccc5d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.818252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b7099-26b6-42b2-bca6-402a0bad984f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:03.818561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29353e3a-344b-4843-84b7-c1ca43bccc5d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.818664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b7099-26b6-42b2-bca6-402a0bad984f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.819963 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29353e3a-344b-4843-84b7-c1ca43bccc5d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.820071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b7099-26b6-42b2-bca6-402a0bad984f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.832648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 498/990] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-29353e3a-344b-4843-84b7-c1ca43bccc5d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:03.832884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:03.833867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:03.834699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:03.835494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a3cd2-390a-4901-93a3-a47239d09b2a None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.835577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 493/991] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:03.835647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a3cd2-390a-4901-93a3-a47239d09b2a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.835647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a3cd2-390a-4901-93a3-a47239d09b2a None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.836950 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 499/992] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:03.838907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29353e3a-344b-4843-84b7-c1ca43bccc5d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.840231 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a3cd2-390a-4901-93a3-a47239d09b2a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:03.867822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:03.941434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a3cd2-390a-4901-93a3-a47239d09b2a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.942818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29353e3a-344b-4843-84b7-c1ca43bccc5d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:03.976707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41642b37-beb8-4b7c-943a-e595f98bf2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.977269 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a080d7-65a9-4739-bb01-3f7d4347d84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:03.977386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642b37-beb8-4b7c-943a-e595f98bf2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.977631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642b37-beb8-4b7c-943a-e595f98bf2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.977904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41642b37-beb8-4b7c-943a-e595f98bf2d3 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.977996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a080d7-65a9-4739-bb01-3f7d4347d84d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.978187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a080d7-65a9-4739-bb01-3f7d4347d84d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.978458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a080d7-65a9-4739-bb01-3f7d4347d84d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.978645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642b37-beb8-4b7c-943a-e595f98bf2d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:03.978970 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642b37-beb8-4b7c-943a-e595f98bf2d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.979312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a080d7-65a9-4739-bb01-3f7d4347d84d None admin] RBAC: Adding query filter params (role.id=683c59f919e14e338161fe36d0f44320, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=a9da3c101fd64bb496c7e5512edc9bf0) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:03.979624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a080d7-65a9-4739-bb01-3f7d4347d84d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:03.980348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41642b37-beb8-4b7c-943a-e595f98bf2d3 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.981046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a080d7-65a9-4739-bb01-3f7d4347d84d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:03.985272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 500/993] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:03.985272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963937f-fb7c-4f89-a31f-da39c94dcec4 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:03.985272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963937f-fb7c-4f89-a31f-da39c94dcec4 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:03.985272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f963937f-fb7c-4f89-a31f-da39c94dcec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:03.990724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 494/994] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/role_assignments?user.id=a9da3c101fd64bb496c7e5512edc9bf0&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=683c59f919e14e338161fe36d0f44320 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:03.991388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a080d7-65a9-4739-bb01-3f7d4347d84d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.006758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-f963937f-fb7c-4f89-a31f-da39c94dcec4 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:04.008027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f963937f-fb7c-4f89-a31f-da39c94dcec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:04.032917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.090082 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 501/995] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:04.098196 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.109209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a080d7-65a9-4739-bb01-3f7d4347d84d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.114052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963937f-fb7c-4f89-a31f-da39c94dcec4 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.151673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95e232-bd78-4805-88b7-19ce8fa87ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.152355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95e232-bd78-4805-88b7-19ce8fa87ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.152640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95e232-bd78-4805-88b7-19ce8fa87ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.153100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b95e232-bd78-4805-88b7-19ce8fa87ec7 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.153627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95e232-bd78-4805-88b7-19ce8fa87ec7 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:04.153935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95e232-bd78-4805-88b7-19ce8fa87ec7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.155357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b95e232-bd78-4805-88b7-19ce8fa87ec7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.161942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 495/996] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:04.167641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95e232-bd78-4805-88b7-19ce8fa87ec7 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.248724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f963937f-fb7c-4f89-a31f-da39c94dcec4 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.289166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea276a-767f-4322-b2c8-b9e103f05992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.289899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea276a-767f-4322-b2c8-b9e103f05992 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.290184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea276a-767f-4322-b2c8-b9e103f05992 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.290459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea276a-767f-4322-b2c8-b9e103f05992 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.291136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea276a-767f-4322-b2c8-b9e103f05992 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.292552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea276a-767f-4322-b2c8-b9e103f05992 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.292655 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b95e232-bd78-4805-88b7-19ce8fa87ec7 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-d5ea276a-767f-4322-b2c8-b9e103f05992 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:04.304813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:04.305849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:04.306692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 502/997] 10.222.0.48 () {56 vars in 1126 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:04.311765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea276a-767f-4322-b2c8-b9e103f05992 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.332097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dc1b5-9c34-435d-9204-f5482a5fb365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.332762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dc1b5-9c34-435d-9204-f5482a5fb365 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.333048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dc1b5-9c34-435d-9204-f5482a5fb365 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.333331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91dc1b5-9c34-435d-9204-f5482a5fb365 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.334132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dc1b5-9c34-435d-9204-f5482a5fb365 None admin] RBAC: Adding query filter params (interface=public, service_id=570aaccf5edf4b4dbaafe7cebfca57a2, region_id=RegionOne) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:04.334447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dc1b5-9c34-435d-9204-f5482a5fb365 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.335915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91dc1b5-9c34-435d-9204-f5482a5fb365 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.336799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.342102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 496/998] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/endpoints?service_id=570aaccf5edf4b4dbaafe7cebfca57a2&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:04.348164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dc1b5-9c34-435d-9204-f5482a5fb365 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.367795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.430012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea276a-767f-4322-b2c8-b9e103f05992 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.456424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91dc1b5-9c34-435d-9204-f5482a5fb365 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.466525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15ed34-348f-4230-ad6c-f3a729687ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.467522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ed34-348f-4230-ad6c-f3a729687ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.467956 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ed34-348f-4230-ad6c-f3a729687ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.468235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e15ed34-348f-4230-ad6c-f3a729687ce6 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.468942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15ed34-348f-4230-ad6c-f3a729687ce6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:04.469255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15ed34-348f-4230-ad6c-f3a729687ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.470677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e15ed34-348f-4230-ad6c-f3a729687ce6 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.480991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 503/999] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:04.482015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15ed34-348f-4230-ad6c-f3a729687ce6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.498703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d963b5a-a6be-4eda-b092-97371717c25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.499715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963b5a-a6be-4eda-b092-97371717c25e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.500004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963b5a-a6be-4eda-b092-97371717c25e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.500441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d963b5a-a6be-4eda-b092-97371717c25e None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.501424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d963b5a-a6be-4eda-b092-97371717c25e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.502854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d963b5a-a6be-4eda-b092-97371717c25e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.522987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 497/1000] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:06:04.575318 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.593638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e15ed34-348f-4230-ad6c-f3a729687ce6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.629819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e37765-f642-4e0c-ac3e-25f4baf74a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.630505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e37765-f642-4e0c-ac3e-25f4baf74a5d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.630790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e37765-f642-4e0c-ac3e-25f4baf74a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.631098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e37765-f642-4e0c-ac3e-25f4baf74a5d None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.631821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e37765-f642-4e0c-ac3e-25f4baf74a5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:04.632131 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e37765-f642-4e0c-ac3e-25f4baf74a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.633534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e37765-f642-4e0c-ac3e-25f4baf74a5d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.643880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 504/1001] 10.222.0.48 () {56 vars in 1122 bytes} [Thu Jul 21 04:06:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:04.645021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d963b5a-a6be-4eda-b092-97371717c25e None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:04.734466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:04.753808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d963b5a-a6be-4eda-b092-97371717c25e None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:04.788469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dccda-f872-409d-b0ec-a056e66b687b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:04.789120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dccda-f872-409d-b0ec-a056e66b687b None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:04.789405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dccda-f872-409d-b0ec-a056e66b687b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:04.789680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dccda-f872-409d-b0ec-a056e66b687b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:04.790419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dccda-f872-409d-b0ec-a056e66b687b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:04.791812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926dccda-f872-409d-b0ec-a056e66b687b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:04.808111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 498/1002] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:06:06.105551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084f4c-4b9e-4bee-ae67-67b7603fc44c None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.106076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084f4c-4b9e-4bee-ae67-67b7603fc44c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.106157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66084f4c-4b9e-4bee-ae67-67b7603fc44c None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.107675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 505/1003] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:06.113050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74d153-1195-4461-a80d-4610d64d3372 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.113437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74d153-1195-4461-a80d-4610d64d3372 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.113602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab74d153-1195-4461-a80d-4610d64d3372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.130805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-ab74d153-1195-4461-a80d-4610d64d3372 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:06.132016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ab74d153-1195-4461-a80d-4610d64d3372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:06.214568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 499/1004] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:06.237380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66084f4c-4b9e-4bee-ae67-67b7603fc44c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.349631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66084f4c-4b9e-4bee-ae67-67b7603fc44c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.383736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0cc2b-efa9-47f8-a020-035ffaf202fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.384454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0cc2b-efa9-47f8-a020-035ffaf202fe None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.384736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0cc2b-efa9-47f8-a020-035ffaf202fe None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.385011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc0cc2b-efa9-47f8-a020-035ffaf202fe None admin] PATH_INFO: `/v3/services/image` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.385659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0cc2b-efa9-47f8-a020-035ffaf202fe None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.387068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc0cc2b-efa9-47f8-a020-035ffaf202fe None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-3cc0cc2b-efa9-47f8-a020-035ffaf202fe None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:06.398793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:06.399942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:06.400782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:06.403271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 506/1005] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:06.405977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74d153-1195-4461-a80d-4610d64d3372 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.473855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.511216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab74d153-1195-4461-a80d-4610d64d3372 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.547801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5db9b1-5e9d-462d-9105-36deb09c48ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.548470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db9b1-5e9d-462d-9105-36deb09c48ac None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.548878 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db9b1-5e9d-462d-9105-36deb09c48ac None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.549288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5db9b1-5e9d-462d-9105-36deb09c48ac None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.550002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5db9b1-5e9d-462d-9105-36deb09c48ac None admin] RBAC: Adding query filter params (name=image) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:06.550311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5db9b1-5e9d-462d-9105-36deb09c48ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.551736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5db9b1-5e9d-462d-9105-36deb09c48ac None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.561583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 500/1006] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:06.562528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0cc2b-efa9-47f8-a020-035ffaf202fe None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.565358 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ea023-ecb7-464c-83f5-90d1a366472a None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.565646 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ea023-ecb7-464c-83f5-90d1a366472a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.565924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ea023-ecb7-464c-83f5-90d1a366472a None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.570994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 501/1007] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:06.572135 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1b899-d989-475b-9fa2-f1f2bfef08d8 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.572417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1b899-d989-475b-9fa2-f1f2bfef08d8 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.572691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f1b899-d989-475b-9fa2-f1f2bfef08d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.579185 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.589902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-a0f1b899-d989-475b-9fa2-f1f2bfef08d8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:06.591090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a0f1b899-d989-475b-9fa2-f1f2bfef08d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:06.660555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 502/1008] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:06.672601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc0cc2b-efa9-47f8-a020-035ffaf202fe None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.684966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1b899-d989-475b-9fa2-f1f2bfef08d8 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.709211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123be747-e956-4857-ad32-4204569a36a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.709879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be747-e956-4857-ad32-4204569a36a4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.710199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be747-e956-4857-ad32-4204569a36a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.710441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123be747-e956-4857-ad32-4204569a36a4 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.711179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be747-e956-4857-ad32-4204569a36a4 None admin] RBAC: Adding query filter params (type=image) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:06.711489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be747-e956-4857-ad32-4204569a36a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.713126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123be747-e956-4857-ad32-4204569a36a4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.717946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 507/1009] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:06.763310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.808659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f1b899-d989-475b-9fa2-f1f2bfef08d8 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:06.847641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e1fba-7a9d-414f-81f4-f824eb9dffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:06.848271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413fb30-8b75-45fa-8cba-9c1ff055ba50 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.848565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413fb30-8b75-45fa-8cba-9c1ff055ba50 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.848849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413fb30-8b75-45fa-8cba-9c1ff055ba50 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.849514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1fba-7a9d-414f-81f4-f824eb9dffd4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.850002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1fba-7a9d-414f-81f4-f824eb9dffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.850261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 508/1010] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:06.850664 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e1fba-7a9d-414f-81f4-f824eb9dffd4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.851377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e1fba-7a9d-414f-81f4-f824eb9dffd4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:06.852979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e1fba-7a9d-414f-81f4-f824eb9dffd4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:06.857187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f441-03ff-41b4-b97b-81d4bd02fd4b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:06.857474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f441-03ff-41b4-b97b-81d4bd02fd4b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:06.857888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153f441-03ff-41b4-b97b-81d4bd02fd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-032e1fba-7a9d-414f-81f4-f824eb9dffd4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:06.871099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:06.872406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 21 04:06:06.873443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:06.876009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 503/1011] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:06.878592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1153f441-03ff-41b4-b97b-81d4bd02fd4b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:06.879807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1153f441-03ff-41b4-b97b-81d4bd02fd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:06.882257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e1fba-7a9d-414f-81f4-f824eb9dffd4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.952463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 509/1012] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:06 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:06.976064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f441-03ff-41b4-b97b-81d4bd02fd4b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:06.984029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:06.999429 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e1fba-7a9d-414f-81f4-f824eb9dffd4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:07.026711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:07.039829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670988fa-4348-4587-8695-fa5521e127d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:07.040502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670988fa-4348-4587-8695-fa5521e127d9 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.040782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670988fa-4348-4587-8695-fa5521e127d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.041053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670988fa-4348-4587-8695-fa5521e127d9 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.041953 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670988fa-4348-4587-8695-fa5521e127d9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:07.042061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670988fa-4348-4587-8695-fa5521e127d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:07.043466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670988fa-4348-4587-8695-fa5521e127d9 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:07.048449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 504/1013] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:07.054483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670988fa-4348-4587-8695-fa5521e127d9 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:07.092191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153f441-03ff-41b4-b97b-81d4bd02fd4b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:07.127560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a76ea-eb04-4c3d-a71c-a0d4016e4fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:07.128393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a76ea-eb04-4c3d-a71c-a0d4016e4fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.128631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a76ea-eb04-4c3d-a71c-a0d4016e4fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.128892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a76ea-eb04-4c3d-a71c-a0d4016e4fe7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.130071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a76ea-eb04-4c3d-a71c-a0d4016e4fe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:07.131565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a76ea-eb04-4c3d-a71c-a0d4016e4fe7 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:07.133385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 510/1014] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:07.138839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a76ea-eb04-4c3d-a71c-a0d4016e4fe7 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:07.166339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670988fa-4348-4587-8695-fa5521e127d9 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:07.213637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308143bf-9998-45a0-b4e9-74e6e16efd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:07.214282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308143bf-9998-45a0-b4e9-74e6e16efd69 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.214510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308143bf-9998-45a0-b4e9-74e6e16efd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.214788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308143bf-9998-45a0-b4e9-74e6e16efd69 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.215538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308143bf-9998-45a0-b4e9-74e6e16efd69 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:07.215846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308143bf-9998-45a0-b4e9-74e6e16efd69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:07.217225 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308143bf-9998-45a0-b4e9-74e6e16efd69 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:07.222995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 505/1015] 10.222.0.48 () {56 vars in 1112 bytes} [Thu Jul 21 04:06:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:07.228281 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:07.228469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308143bf-9998-45a0-b4e9-74e6e16efd69 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:07.255909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a76ea-eb04-4c3d-a71c-a0d4016e4fe7 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:07.290855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:07.295239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b1e227-57d5-45a8-83ef-35e279142d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:07.296062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1e227-57d5-45a8-83ef-35e279142d72 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.296395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1e227-57d5-45a8-83ef-35e279142d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.296939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b1e227-57d5-45a8-83ef-35e279142d72 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.297655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1e227-57d5-45a8-83ef-35e279142d72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:07.299805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b1e227-57d5-45a8-83ef-35e279142d72 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:07.326505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 511/1016] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:07 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:06:07.343568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308143bf-9998-45a0-b4e9-74e6e16efd69 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:07.383597 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972356de-9e3c-46ee-956d-7a6ca9c1aa56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:07.384288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972356de-9e3c-46ee-956d-7a6ca9c1aa56 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:07.384581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972356de-9e3c-46ee-956d-7a6ca9c1aa56 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:07.384859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972356de-9e3c-46ee-956d-7a6ca9c1aa56 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:07.385624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972356de-9e3c-46ee-956d-7a6ca9c1aa56 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:07.387072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972356de-9e3c-46ee-956d-7a6ca9c1aa56 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:07.412462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 506/1017] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:08.773472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c5919-49b1-41a6-9f84-0abedc88ef09 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:08.773993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c5919-49b1-41a6-9f84-0abedc88ef09 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:08.774073 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c5919-49b1-41a6-9f84-0abedc88ef09 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:08.775580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 512/1018] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:08.780517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ccfd0-f654-4dbf-be4f-98c47e4aa762 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:08.780909 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ccfd0-f654-4dbf-be4f-98c47e4aa762 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:08.781069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80ccfd0-f654-4dbf-be4f-98c47e4aa762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:08.797582 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-a80ccfd0-f654-4dbf-be4f-98c47e4aa762 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:08.799643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a80ccfd0-f654-4dbf-be4f-98c47e4aa762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:08.874884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 507/1019] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:08 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:08.895687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c5919-49b1-41a6-9f84-0abedc88ef09 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:09.000871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c5919-49b1-41a6-9f84-0abedc88ef09 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.028449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:09.038693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb169f20-0621-41b3-a2cc-e4b7f0a0ff6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.039522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb169f20-0621-41b3-a2cc-e4b7f0a0ff6a None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.040175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb169f20-0621-41b3-a2cc-e4b7f0a0ff6a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.040695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb169f20-0621-41b3-a2cc-e4b7f0a0ff6a None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.041738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb169f20-0621-41b3-a2cc-e4b7f0a0ff6a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:09.043574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb169f20-0621-41b3-a2cc-e4b7f0a0ff6a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:09.066983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 513/1020] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:08 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:09.409701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01434-1567-4e3e-aa05-c722089b4acb None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.409880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01434-1567-4e3e-aa05-c722089b4acb None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.410161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e01434-1567-4e3e-aa05-c722089b4acb None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.411704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 508/1021] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:09.416838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81af8d-870d-4bf8-914a-51485508608b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.417130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81af8d-870d-4bf8-914a-51485508608b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.417405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81af8d-870d-4bf8-914a-51485508608b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.435770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-bf81af8d-870d-4bf8-914a-51485508608b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:09.436950 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-bf81af8d-870d-4bf8-914a-51485508608b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:09.513025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 514/1022] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:09.538503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e01434-1567-4e3e-aa05-c722089b4acb None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:09.577452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:09.579184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375afb-b5b5-4d6d-9d42-72d82b347c0d None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.579504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375afb-b5b5-4d6d-9d42-72d82b347c0d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.579888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2375afb-b5b5-4d6d-9d42-72d82b347c0d None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.581491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 515/1023] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:09.586854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e024a4-3bf8-4e71-9d71-7075fb478fa7 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.587174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e024a4-3bf8-4e71-9d71-7075fb478fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.587463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e024a4-3bf8-4e71-9d71-7075fb478fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.606689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-49e024a4-3bf8-4e71-9d71-7075fb478fa7 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:09.607947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-49e024a4-3bf8-4e71-9d71-7075fb478fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:09.662739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e01434-1567-4e3e-aa05-c722089b4acb None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.681733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 516/1024] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:09.698848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6ead9-6861-404d-a5fc-08a608c2d26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.699668 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6ead9-6861-404d-a5fc-08a608c2d26b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.699954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6ead9-6861-404d-a5fc-08a608c2d26b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.700233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6ead9-6861-404d-a5fc-08a608c2d26b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.701416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6ead9-6861-404d-a5fc-08a608c2d26b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:09.702862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6ead9-6861-404d-a5fc-08a608c2d26b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:09.709235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 509/1025] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:09.709391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e024a4-3bf8-4e71-9d71-7075fb478fa7 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:09.710019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6ead9-6861-404d-a5fc-08a608c2d26b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:09.750161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:09.812322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e024a4-3bf8-4e71-9d71-7075fb478fa7 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.818941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6ead9-6861-404d-a5fc-08a608c2d26b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:09.821862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:09.856276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ccc9d-67d3-4c31-bb7b-d8f94a116af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.856945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccc9d-67d3-4c31-bb7b-d8f94a116af9 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.857228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccc9d-67d3-4c31-bb7b-d8f94a116af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.857333 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bcd06-3e82-44c8-ace7-faf12e40bce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:09.857528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ccc9d-67d3-4c31-bb7b-d8f94a116af9 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.858132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bcd06-3e82-44c8-ace7-faf12e40bce0 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:09.858231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ccc9d-67d3-4c31-bb7b-d8f94a116af9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:09.858419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bcd06-3e82-44c8-ace7-faf12e40bce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:09.858700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6bcd06-3e82-44c8-ace7-faf12e40bce0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:09.859638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ccc9d-67d3-4c31-bb7b-d8f94a116af9 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:09.870025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6bcd06-3e82-44c8-ace7-faf12e40bce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-4d6bcd06-3e82-44c8-ace7-faf12e40bce0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:09.879157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:09.880157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:09.881051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 517/1026] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 21 04:06:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:09.895255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 510/1027] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:06:09 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:09.895474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bcd06-3e82-44c8-ace7-faf12e40bce0 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.007613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6bcd06-3e82-44c8-ace7-faf12e40bce0 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.009324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.048046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbe479-a87d-4357-9f35-a3e05d2d6207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.049441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe479-a87d-4357-9f35-a3e05d2d6207 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.049769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe479-a87d-4357-9f35-a3e05d2d6207 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.050154 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dbe479-a87d-4357-9f35-a3e05d2d6207 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.050918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbe479-a87d-4357-9f35-a3e05d2d6207 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:10.051260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbe479-a87d-4357-9f35-a3e05d2d6207 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.052653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dbe479-a87d-4357-9f35-a3e05d2d6207 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.061693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 518/1028] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:10.067660 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ccc9d-67d3-4c31-bb7b-d8f94a116af9 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.177691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ccc9d-67d3-4c31-bb7b-d8f94a116af9 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.219710 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b4ae3-093d-45d0-b74c-da891143aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.221035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b4ae3-093d-45d0-b74c-da891143aa7a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.221349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b4ae3-093d-45d0-b74c-da891143aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.221638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b4ae3-093d-45d0-b74c-da891143aa7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.232883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b4ae3-093d-45d0-b74c-da891143aa7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.234339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b4ae3-093d-45d0-b74c-da891143aa7a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-b07b4ae3-093d-45d0-b74c-da891143aa7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:10.252767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:10.253767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:10.254669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:10.254669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:10.254669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:10.254669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:10.254669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 511/1029] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:10.260748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbe479-a87d-4357-9f35-a3e05d2d6207 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.367407 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dbe479-a87d-4357-9f35-a3e05d2d6207 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.400492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2f480-4e91-44f5-bb5f-837e36f194e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.401152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2f480-4e91-44f5-bb5f-837e36f194e7 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.401435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2f480-4e91-44f5-bb5f-837e36f194e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.401712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2f480-4e91-44f5-bb5f-837e36f194e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.402433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2f480-4e91-44f5-bb5f-837e36f194e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:10.402741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2f480-4e91-44f5-bb5f-837e36f194e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.404154 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2f480-4e91-44f5-bb5f-837e36f194e7 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.421109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 519/1030] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:10.422296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b4ae3-093d-45d0-b74c-da891143aa7a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.437599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.529232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b4ae3-093d-45d0-b74c-da891143aa7a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.563617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d403a6a-afe4-4a23-986a-5f10a0411861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.565055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d403a6a-afe4-4a23-986a-5f10a0411861 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.565409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d403a6a-afe4-4a23-986a-5f10a0411861 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.565705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d403a6a-afe4-4a23-986a-5f10a0411861 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.577562 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d403a6a-afe4-4a23-986a-5f10a0411861 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.580248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d403a6a-afe4-4a23-986a-5f10a0411861 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-7d403a6a-afe4-4a23-986a-5f10a0411861 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:10.596832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:10.597890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:10.598887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 512/1031] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:10.603851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2f480-4e91-44f5-bb5f-837e36f194e7 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.631454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.708859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2f480-4e91-44f5-bb5f-837e36f194e7 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.743768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613580bf-bab8-4280-bbe4-3b8433157d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.744432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613580bf-bab8-4280-bbe4-3b8433157d78 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.744711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613580bf-bab8-4280-bbe4-3b8433157d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.744984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613580bf-bab8-4280-bbe4-3b8433157d78 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.745816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613580bf-bab8-4280-bbe4-3b8433157d78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:10.746123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613580bf-bab8-4280-bbe4-3b8433157d78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.747579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613580bf-bab8-4280-bbe4-3b8433157d78 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:10.770343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 520/1032] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:10.771903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d403a6a-afe4-4a23-986a-5f10a0411861 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:10.846039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:10.878405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d403a6a-afe4-4a23-986a-5f10a0411861 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:10.915067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77977b-0f9e-4250-bd6b-d632a5628876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:10.915727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77977b-0f9e-4250-bd6b-d632a5628876 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:10.916015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77977b-0f9e-4250-bd6b-d632a5628876 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:10.916293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77977b-0f9e-4250-bd6b-d632a5628876 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:10.984392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77977b-0f9e-4250-bd6b-d632a5628876 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:10.985863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77977b-0f9e-4250-bd6b-d632a5628876 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.055835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.092637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 513/1033] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 04:06:11.094183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613580bf-bab8-4280-bbe4-3b8433157d78 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.124844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b208d-f771-48ad-afbc-d0ae918bb035 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.125030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b208d-f771-48ad-afbc-d0ae918bb035 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.125314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b208d-f771-48ad-afbc-d0ae918bb035 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.127477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 514/1034] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:11.132643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3691e0-1cab-4199-83e2-94cfd62d7d7d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.132933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3691e0-1cab-4199-83e2-94cfd62d7d7d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.133214 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3691e0-1cab-4199-83e2-94cfd62d7d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.150376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-4e3691e0-1cab-4199-83e2-94cfd62d7d7d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:11.151605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4e3691e0-1cab-4199-83e2-94cfd62d7d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:11.183423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.210753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613580bf-bab8-4280-bbe4-3b8433157d78 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.227877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 515/1035] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:11.248336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa30a7-5c6a-4a32-a43d-673d93e20082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.249130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa30a7-5c6a-4a32-a43d-673d93e20082 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.249439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa30a7-5c6a-4a32-a43d-673d93e20082 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.249680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa30a7-5c6a-4a32-a43d-673d93e20082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.257297 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3691e0-1cab-4199-83e2-94cfd62d7d7d None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.260603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa30a7-5c6a-4a32-a43d-673d93e20082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.262062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa30a7-5c6a-4a32-a43d-673d93e20082 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-89aa30a7-5c6a-4a32-a43d-673d93e20082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:11.283535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:11.284444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:11.285345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:11.285345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:11.285345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:11.285345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:11.285857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 521/1036] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:11.290448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa30a7-5c6a-4a32-a43d-673d93e20082 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.367227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3691e0-1cab-4199-83e2-94cfd62d7d7d None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.368863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.399059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa30a7-5c6a-4a32-a43d-673d93e20082 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.405019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a2ec-f158-4bb8-8111-34504c1858ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.405805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a2ec-f158-4bb8-8111-34504c1858ba None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.406093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a2ec-f158-4bb8-8111-34504c1858ba None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.406365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02a2ec-f158-4bb8-8111-34504c1858ba None admin] PATH_INFO: `/v3/services/image` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.407050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02a2ec-f158-4bb8-8111-34504c1858ba None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.409193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02a2ec-f158-4bb8-8111-34504c1858ba None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-7d02a2ec-f158-4bb8-8111-34504c1858ba None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:11.420912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:11.421934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:11.422800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 516/1037] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:11.428595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a2ec-f158-4bb8-8111-34504c1858ba None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.439579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b3080-9d96-4df6-9e8e-975fe807517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.440659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b3080-9d96-4df6-9e8e-975fe807517d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.440946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b3080-9d96-4df6-9e8e-975fe807517d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.441532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5b3080-9d96-4df6-9e8e-975fe807517d None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.442308 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b3080-9d96-4df6-9e8e-975fe807517d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.442621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b3080-9d96-4df6-9e8e-975fe807517d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.444073 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5b3080-9d96-4df6-9e8e-975fe807517d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.445691 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.463323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 522/1038] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:11.464218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b3080-9d96-4df6-9e8e-975fe807517d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.536708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02a2ec-f158-4bb8-8111-34504c1858ba None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.573572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08146c2-772a-40ab-85e5-2d0e89aceddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.574320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08146c2-772a-40ab-85e5-2d0e89aceddc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.574608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08146c2-772a-40ab-85e5-2d0e89aceddc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.574891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08146c2-772a-40ab-85e5-2d0e89aceddc None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.575632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08146c2-772a-40ab-85e5-2d0e89aceddc None admin] RBAC: Adding query filter params (name=image) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.575942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08146c2-772a-40ab-85e5-2d0e89aceddc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.577318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08146c2-772a-40ab-85e5-2d0e89aceddc None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.580643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5b3080-9d96-4df6-9e8e-975fe807517d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.582788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 517/1039] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:11.589164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08146c2-772a-40ab-85e5-2d0e89aceddc None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.617781 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac1054-a638-49c2-b180-6b959da07a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.618650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac1054-a638-49c2-b180-6b959da07a64 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.618944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac1054-a638-49c2-b180-6b959da07a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.619247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac1054-a638-49c2-b180-6b959da07a64 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.623847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.626457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac1054-a638-49c2-b180-6b959da07a64 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.628559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac1054-a638-49c2-b180-6b959da07a64 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f0ac1054-a638-49c2-b180-6b959da07a64 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:11.643707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:11.644635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:11.645563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:11.645563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:11.645563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:11.645563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:11.645563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:11.645563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:11.645563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:11.645563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:11.645563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 523/1040] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:11.651236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac1054-a638-49c2-b180-6b959da07a64 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.701336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08146c2-772a-40ab-85e5-2d0e89aceddc None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.724170 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.740003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88761e93-4dcc-490f-9bdb-849202206685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.740673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88761e93-4dcc-490f-9bdb-849202206685 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.740959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88761e93-4dcc-490f-9bdb-849202206685 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.741243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88761e93-4dcc-490f-9bdb-849202206685 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.741949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88761e93-4dcc-490f-9bdb-849202206685 None admin] RBAC: Adding query filter params (type=image) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.742257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88761e93-4dcc-490f-9bdb-849202206685 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.743670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88761e93-4dcc-490f-9bdb-849202206685 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.748581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 518/1041] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:11.755475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88761e93-4dcc-490f-9bdb-849202206685 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.777767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac1054-a638-49c2-b180-6b959da07a64 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.816483 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68b95-19b0-4bd5-a228-67cb6371415a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.817234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68b95-19b0-4bd5-a228-67cb6371415a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.817580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68b95-19b0-4bd5-a228-67cb6371415a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.817869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e68b95-19b0-4bd5-a228-67cb6371415a None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.818631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68b95-19b0-4bd5-a228-67cb6371415a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.818935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68b95-19b0-4bd5-a228-67cb6371415a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.820527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e68b95-19b0-4bd5-a228-67cb6371415a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.837937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 524/1042] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:11.839683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68b95-19b0-4bd5-a228-67cb6371415a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.858436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.866709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88761e93-4dcc-490f-9bdb-849202206685 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.903000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44115b-ca76-4b1c-83b7-bef72c6f0c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.903918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44115b-ca76-4b1c-83b7-bef72c6f0c32 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.904198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44115b-ca76-4b1c-83b7-bef72c6f0c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.904469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44115b-ca76-4b1c-83b7-bef72c6f0c32 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.905252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44115b-ca76-4b1c-83b7-bef72c6f0c32 None admin] RBAC: Adding query filter params (interface=public, service_id=a4d749a422c247a3a106c9de2d5d4bb4, region_id=RegionOne) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.905563 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44115b-ca76-4b1c-83b7-bef72c6f0c32 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.906930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44115b-ca76-4b1c-83b7-bef72c6f0c32 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:11.912558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 519/1043] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/endpoints?service_id=a4d749a422c247a3a106c9de2d5d4bb4&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:11.918593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44115b-ca76-4b1c-83b7-bef72c6f0c32 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:11.952414 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e68b95-19b0-4bd5-a228-67cb6371415a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:11.968036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:11.991529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988f38b-f1b4-4314-8e86-88b4327e032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:11.992190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988f38b-f1b4-4314-8e86-88b4327e032e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:11.992470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988f38b-f1b4-4314-8e86-88b4327e032e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:11.992742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988f38b-f1b4-4314-8e86-88b4327e032e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:11.993653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988f38b-f1b4-4314-8e86-88b4327e032e None admin] RBAC: Adding query filter params (role.id=683c59f919e14e338161fe36d0f44320, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=5a82fed4ff8845919b1da05f7e8d1d72) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:11.993875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988f38b-f1b4-4314-8e86-88b4327e032e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:11.995325 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c988f38b-f1b4-4314-8e86-88b4327e032e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:12.000944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 525/1044] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/role_assignments?user.id=5a82fed4ff8845919b1da05f7e8d1d72&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=683c59f919e14e338161fe36d0f44320 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:12.029987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44115b-ca76-4b1c-83b7-bef72c6f0c32 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:12.034235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53113a93-232f-49e0-9977-b8f33a6b14d8 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.034847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53113a93-232f-49e0-9977-b8f33a6b14d8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.035157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53113a93-232f-49e0-9977-b8f33a6b14d8 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.036611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 526/1045] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:12.042541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8293c-636f-4a98-a02b-2988f95a60a3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.042827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8293c-636f-4a98-a02b-2988f95a60a3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.043168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a8293c-636f-4a98-a02b-2988f95a60a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.061068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e0a8293c-636f-4a98-a02b-2988f95a60a3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:12.062307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e0a8293c-636f-4a98-a02b-2988f95a60a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:12.072059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fd8ad-7cba-4375-b821-55cffd6024bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:12.072858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd8ad-7cba-4375-b821-55cffd6024bd None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.073148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd8ad-7cba-4375-b821-55cffd6024bd None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.073428 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fd8ad-7cba-4375-b821-55cffd6024bd None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.074125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fd8ad-7cba-4375-b821-55cffd6024bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:12.075684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fd8ad-7cba-4375-b821-55cffd6024bd None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:12.087339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 520/1046] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 21 04:06:11 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:06:12.140614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 527/1047] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:12 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:12.164978 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fd8ad-7cba-4375-b821-55cffd6024bd None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:12.198795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:12.294225 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fd8ad-7cba-4375-b821-55cffd6024bd None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:12.328245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62ba2d-b830-4f20-8f45-ff86ee0bafca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:12.329033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62ba2d-b830-4f20-8f45-ff86ee0bafca None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.329315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62ba2d-b830-4f20-8f45-ff86ee0bafca None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.329585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62ba2d-b830-4f20-8f45-ff86ee0bafca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.340570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62ba2d-b830-4f20-8f45-ff86ee0bafca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-8d62ba2d-b830-4f20-8f45-ff86ee0bafca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:12.348258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:12.349202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:12.350624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 521/1048] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:12.355468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8293c-636f-4a98-a02b-2988f95a60a3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:12.454137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a8293c-636f-4a98-a02b-2988f95a60a3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:12.465110 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:12.491673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab8000-cecb-40cb-8d8d-b65733930f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:12.492344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8000-cecb-40cb-8d8d-b65733930f3b None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.492627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8000-cecb-40cb-8d8d-b65733930f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.492902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab8000-cecb-40cb-8d8d-b65733930f3b None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.493647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab8000-cecb-40cb-8d8d-b65733930f3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:12.493955 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab8000-cecb-40cb-8d8d-b65733930f3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:12.495365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cab8000-cecb-40cb-8d8d-b65733930f3b None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:12.504688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 528/1049] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:12.510123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62ba2d-b830-4f20-8f45-ff86ee0bafca None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:12.592824 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:12.611746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62ba2d-b830-4f20-8f45-ff86ee0bafca None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:12.645416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2546246-f2ad-4008-9986-3611c6b54364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:12.646287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2546246-f2ad-4008-9986-3611c6b54364 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.646573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2546246-f2ad-4008-9986-3611c6b54364 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.646855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2546246-f2ad-4008-9986-3611c6b54364 None admin] PATH_INFO: `/v3/users/1ba35d5a932142f188f716bedd90074e` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.660325 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2546246-f2ad-4008-9986-3611c6b54364 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba35d5a932142f188f716bedd90074e)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:12.661770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2546246-f2ad-4008-9986-3611c6b54364 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:12.668078 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 522/1050] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:12 2022] GET /identity/v3/users/1ba35d5a932142f188f716bedd90074e => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:12.669578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab8000-cecb-40cb-8d8d-b65733930f3b None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:12.772282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab8000-cecb-40cb-8d8d-b65733930f3b None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:12.805302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f96411-d4cf-4cdd-b269-a0b7c13ba967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:12.805955 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f96411-d4cf-4cdd-b269-a0b7c13ba967 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:12.806234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f96411-d4cf-4cdd-b269-a0b7c13ba967 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:12.806509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f96411-d4cf-4cdd-b269-a0b7c13ba967 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:12.846486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:12.878005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f96411-d4cf-4cdd-b269-a0b7c13ba967 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:12.879522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f96411-d4cf-4cdd-b269-a0b7c13ba967 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:12.975180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 529/1051] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:12 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:12.980918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2546246-f2ad-4008-9986-3611c6b54364 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:13.083470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2546246-f2ad-4008-9986-3611c6b54364 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:13.118750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e7965-69dc-4940-985c-2ba8b815b04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:13.120033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7965-69dc-4940-985c-2ba8b815b04a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.120543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7965-69dc-4940-985c-2ba8b815b04a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.121025 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e7965-69dc-4940-985c-2ba8b815b04a None admin] PATH_INFO: `/v3/projects/168b73ab730149f6abbe36ba7281d857` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.122567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e7965-69dc-4940-985c-2ba8b815b04a None admin] RBAC: Authorizing `identity:get_project(project_id=168b73ab730149f6abbe36ba7281d857)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:13.124313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e7965-69dc-4940-985c-2ba8b815b04a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:13.127170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 523/1052] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:12 2022] GET /identity/v3/projects/168b73ab730149f6abbe36ba7281d857 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:13.132889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f96411-d4cf-4cdd-b269-a0b7c13ba967 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:13.205328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:13.239812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f96411-d4cf-4cdd-b269-a0b7c13ba967 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:13.277255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db34a28-0e51-408f-a839-2004475531dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:13.277912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34a28-0e51-408f-a839-2004475531dd None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:13.278196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34a28-0e51-408f-a839-2004475531dd None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:13.278475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db34a28-0e51-408f-a839-2004475531dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:13.279348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db34a28-0e51-408f-a839-2004475531dd None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=168b73ab730149f6abbe36ba7281d857, user.id=1ba35d5a932142f188f716bedd90074e) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:13.279663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db34a28-0e51-408f-a839-2004475531dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:13.281108 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db34a28-0e51-408f-a839-2004475531dd None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:13.287647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 530/1053] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:13 2022] GET /identity/v3/role_assignments?user.id=1ba35d5a932142f188f716bedd90074e&scope.project.id=168b73ab730149f6abbe36ba7281d857&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:14.046701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741bac-c37c-49ab-a851-f4e5e9f8ac67 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.047299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741bac-c37c-49ab-a851-f4e5e9f8ac67 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.047299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06741bac-c37c-49ab-a851-f4e5e9f8ac67 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.050998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 524/1054] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:14.053867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3df7-ff71-4ea2-aa01-84131777bff1 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.054163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3df7-ff71-4ea2-aa01-84131777bff1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.054448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab3df7-ff71-4ea2-aa01-84131777bff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.071015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-91ab3df7-ff71-4ea2-aa01-84131777bff1 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:14.072204 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-91ab3df7-ff71-4ea2-aa01-84131777bff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:14.141342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 531/1055] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:14.165149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741bac-c37c-49ab-a851-f4e5e9f8ac67 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.176134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57643c5-a080-4f68-b9dd-b5fd540b101f None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.176427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57643c5-a080-4f68-b9dd-b5fd540b101f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.176701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57643c5-a080-4f68-b9dd-b5fd540b101f None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.177152 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.178395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 532/1056] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:14.184678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419d4c-6dc8-423c-a197-de2d3ec4087e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.184678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419d4c-6dc8-423c-a197-de2d3ec4087e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.184678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56419d4c-6dc8-423c-a197-de2d3ec4087e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.203506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-56419d4c-6dc8-423c-a197-de2d3ec4087e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:14.205234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-56419d4c-6dc8-423c-a197-de2d3ec4087e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:14.271130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.282031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 533/1057] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:14 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:14.287731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06741bac-c37c-49ab-a851-f4e5e9f8ac67 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.305065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56419d4c-6dc8-423c-a197-de2d3ec4087e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.331198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c3479-3153-4872-9fbc-98263a3a71e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.332270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c3479-3153-4872-9fbc-98263a3a71e8 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.332684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c3479-3153-4872-9fbc-98263a3a71e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.332985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8c3479-3153-4872-9fbc-98263a3a71e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.347027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8c3479-3153-4872-9fbc-98263a3a71e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-cb8c3479-3153-4872-9fbc-98263a3a71e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:14.357379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:14.358371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:14.365432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 525/1058] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:14.366477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c3479-3153-4872-9fbc-98263a3a71e8 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.412293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56419d4c-6dc8-423c-a197-de2d3ec4087e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.439552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.449619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3f503-fff2-4c83-9df1-c43258932038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.450412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3f503-fff2-4c83-9df1-c43258932038 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.451077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3f503-fff2-4c83-9df1-c43258932038 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.451360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3f503-fff2-4c83-9df1-c43258932038 None admin] PATH_INFO: `/v3/services/image` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.452303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3f503-fff2-4c83-9df1-c43258932038 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.453692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3f503-fff2-4c83-9df1-c43258932038 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-5ff3f503-fff2-4c83-9df1-c43258932038 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:14.466100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:14.467118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:14.468063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 534/1059] 10.222.0.48 () {56 vars in 1105 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:14.474273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3f503-fff2-4c83-9df1-c43258932038 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.478190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8c3479-3153-4872-9fbc-98263a3a71e8 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.513063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71bf1b-c358-4429-bdc2-76d4351dc9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.513727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71bf1b-c358-4429-bdc2-76d4351dc9c7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.514012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71bf1b-c358-4429-bdc2-76d4351dc9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.514293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71bf1b-c358-4429-bdc2-76d4351dc9c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.515081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71bf1b-c358-4429-bdc2-76d4351dc9c7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:14.515392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71bf1b-c358-4429-bdc2-76d4351dc9c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.516821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac71bf1b-c358-4429-bdc2-76d4351dc9c7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.525699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 526/1060] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:14.531190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71bf1b-c358-4429-bdc2-76d4351dc9c7 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.541458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.586530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3f503-fff2-4c83-9df1-c43258932038 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.623981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d7e70-e766-4804-bc05-bcf7192be122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.624650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d7e70-e766-4804-bc05-bcf7192be122 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.624938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d7e70-e766-4804-bc05-bcf7192be122 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.625227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06d7e70-e766-4804-bc05-bcf7192be122 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.625932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d7e70-e766-4804-bc05-bcf7192be122 None admin] RBAC: Adding query filter params (name=image) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:14.626242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d7e70-e766-4804-bc05-bcf7192be122 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.628376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06d7e70-e766-4804-bc05-bcf7192be122 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.638237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 535/1061] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:14.639216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d7e70-e766-4804-bc05-bcf7192be122 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.641585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71bf1b-c358-4429-bdc2-76d4351dc9c7 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.670796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.677682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c0d5-54c5-47c7-a3df-febe02659082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.678467 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c0d5-54c5-47c7-a3df-febe02659082 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.678752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c0d5-54c5-47c7-a3df-febe02659082 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.679054 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06c0d5-54c5-47c7-a3df-febe02659082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.690556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c0d5-54c5-47c7-a3df-febe02659082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.692044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b06c0d5-54c5-47c7-a3df-febe02659082 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-2b06c0d5-54c5-47c7-a3df-febe02659082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:14.709823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:14.710738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:14.712360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:14.712360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:14.712360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:14.712360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:14.712360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 527/1062] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:14.716951 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c0d5-54c5-47c7-a3df-febe02659082 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.750826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06d7e70-e766-4804-bc05-bcf7192be122 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.776837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.791063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ac656-3093-427d-af56-eb95214d3b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.791920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac656-3093-427d-af56-eb95214d3b9c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.792203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac656-3093-427d-af56-eb95214d3b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.792479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ac656-3093-427d-af56-eb95214d3b9c None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.793229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ac656-3093-427d-af56-eb95214d3b9c None admin] RBAC: Adding query filter params (type=image) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:14.793540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ac656-3093-427d-af56-eb95214d3b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.795225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ac656-3093-427d-af56-eb95214d3b9c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.801383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 536/1063] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:14.807379 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ac656-3093-427d-af56-eb95214d3b9c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.832990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b06c0d5-54c5-47c7-a3df-febe02659082 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.872629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930702e-7125-4253-85b0-714b00e7583c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.873223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930702e-7125-4253-85b0-714b00e7583c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.873509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930702e-7125-4253-85b0-714b00e7583c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.873790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930702e-7125-4253-85b0-714b00e7583c None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.874511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930702e-7125-4253-85b0-714b00e7583c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:14.874815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930702e-7125-4253-85b0-714b00e7583c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.876240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930702e-7125-4253-85b0-714b00e7583c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.894021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 528/1064] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:14.895691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930702e-7125-4253-85b0-714b00e7583c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:14.918174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ac656-3093-427d-af56-eb95214d3b9c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:14.941329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:14.956786 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbd8e9-a9d3-4b59-b905-7cd2058d745f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:14.957448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd8e9-a9d3-4b59-b905-7cd2058d745f None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:14.957737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd8e9-a9d3-4b59-b905-7cd2058d745f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:14.958016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cbd8e9-a9d3-4b59-b905-7cd2058d745f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:14.958758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbd8e9-a9d3-4b59-b905-7cd2058d745f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:14.960175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cbd8e9-a9d3-4b59-b905-7cd2058d745f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:14.990992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 537/1065] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 21 04:06:14 2022] POST /identity/v3/endpoints => generated 327 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:15.006451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930702e-7125-4253-85b0-714b00e7583c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.052766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf909-3d3c-462f-bd62-b2afbb1adb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.053596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf909-3d3c-462f-bd62-b2afbb1adb62 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.053865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf909-3d3c-462f-bd62-b2afbb1adb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.054145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf909-3d3c-462f-bd62-b2afbb1adb62 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.062515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bf909-3d3c-462f-bd62-b2afbb1adb62 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.064065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bf909-3d3c-462f-bd62-b2afbb1adb62 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-ad4bf909-3d3c-462f-bd62-b2afbb1adb62 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:15.080601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:15.081610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:15.082570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:15.082570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:15.082570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:15.082570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:15.082570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:15.082570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:15.082570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:15.082570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:15.082570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:15.082570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:15.083991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 529/1066] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 21 04:06:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:15.088237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbd8e9-a9d3-4b59-b905-7cd2058d745f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.137593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.203229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cbd8e9-a9d3-4b59-b905-7cd2058d745f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.240088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9576a2a-48bd-490c-b9ef-f43ced324472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.241002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9576a2a-48bd-490c-b9ef-f43ced324472 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.241427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9576a2a-48bd-490c-b9ef-f43ced324472 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.241871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9576a2a-48bd-490c-b9ef-f43ced324472 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.242842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9576a2a-48bd-490c-b9ef-f43ced324472 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:15.243323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9576a2a-48bd-490c-b9ef-f43ced324472 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.244893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9576a2a-48bd-490c-b9ef-f43ced324472 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.262770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 538/1067] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:15.268941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf909-3d3c-462f-bd62-b2afbb1adb62 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.308645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf2cc-2351-40e4-b4e5-1aa38dc3317e None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.309158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf2cc-2351-40e4-b4e5-1aa38dc3317e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.309236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfcf2cc-2351-40e4-b4e5-1aa38dc3317e None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.314736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 539/1068] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:15.316059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1f318-8ab4-493a-aeef-2d0a071b31fe None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.316342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1f318-8ab4-493a-aeef-2d0a071b31fe None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.316611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc1f318-8ab4-493a-aeef-2d0a071b31fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.333010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fbc1f318-8ab4-493a-aeef-2d0a071b31fe None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:15.334185 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fbc1f318-8ab4-493a-aeef-2d0a071b31fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:15.375280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.379304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf909-3d3c-462f-bd62-b2afbb1adb62 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.412025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 540/1069] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:15.414717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b2ec4-803a-476c-b8b0-251de2103fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.415551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b2ec4-803a-476c-b8b0-251de2103fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.415833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b2ec4-803a-476c-b8b0-251de2103fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.416103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b2ec4-803a-476c-b8b0-251de2103fe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.427148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b2ec4-803a-476c-b8b0-251de2103fe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.428612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b2ec4-803a-476c-b8b0-251de2103fe3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.434583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1f318-8ab4-493a-aeef-2d0a071b31fe None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-fd2b2ec4-803a-476c-b8b0-251de2103fe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:15.446444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:15.447485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:15.448385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:15.448385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:15.448385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:15.448385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:15.451328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 530/1070] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:15.453093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b2ec4-803a-476c-b8b0-251de2103fe3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.469001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.545337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc1f318-8ab4-493a-aeef-2d0a071b31fe None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.563343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b2ec4-803a-476c-b8b0-251de2103fe3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.582635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb707ddb-bbb6-4f16-ae66-71af86d82e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.583594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707ddb-bbb6-4f16-ae66-71af86d82e09 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.583881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707ddb-bbb6-4f16-ae66-71af86d82e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.584166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb707ddb-bbb6-4f16-ae66-71af86d82e09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.594833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb707ddb-bbb6-4f16-ae66-71af86d82e09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:15.601304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fcd8a-4a6f-4d5b-b75c-496f85fd792a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.602120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fcd8a-4a6f-4d5b-b75c-496f85fd792a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.602561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fcd8a-4a6f-4d5b-b75c-496f85fd792a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.603020 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6fcd8a-4a6f-4d5b-b75c-496f85fd792a None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-fb707ddb-bbb6-4f16-ae66-71af86d82e09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:15.603329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:15.604441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:15.605319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 541/1071] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:15.606700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fcd8a-4a6f-4d5b-b75c-496f85fd792a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:15.607035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fcd8a-4a6f-4d5b-b75c-496f85fd792a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.608413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6fcd8a-4a6f-4d5b-b75c-496f85fd792a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.611038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb707ddb-bbb6-4f16-ae66-71af86d82e09 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.620517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 531/1072] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:15.625971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fcd8a-4a6f-4d5b-b75c-496f85fd792a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.638377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.713381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.725015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb707ddb-bbb6-4f16-ae66-71af86d82e09 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.731500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6fcd8a-4a6f-4d5b-b75c-496f85fd792a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.762209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c82f95-506d-4d41-9b14-1fcb28f09ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.762871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c82f95-506d-4d41-9b14-1fcb28f09ccf None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.763192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c82f95-506d-4d41-9b14-1fcb28f09ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.763536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c82f95-506d-4d41-9b14-1fcb28f09ccf None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.764385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c82f95-506d-4d41-9b14-1fcb28f09ccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:15.764783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c82f95-506d-4d41-9b14-1fcb28f09ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.766252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c82f95-506d-4d41-9b14-1fcb28f09ccf None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.766532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5838ef7-a93f-4358-8773-c2c3cab9e16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.767858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5838ef7-a93f-4358-8773-c2c3cab9e16f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.768146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5838ef7-a93f-4358-8773-c2c3cab9e16f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.768416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5838ef7-a93f-4358-8773-c2c3cab9e16f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.775089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5838ef7-a93f-4358-8773-c2c3cab9e16f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.776545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5838ef7-a93f-4358-8773-c2c3cab9e16f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.779116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 542/1073] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:15.781264 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c82f95-506d-4d41-9b14-1fcb28f09ccf None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-d5838ef7-a93f-4358-8773-c2c3cab9e16f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:15.795106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:15.796190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:15.797253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:15.797253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:15.797253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:15.797253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:15.797253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:15.797253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:15.797253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:15.797253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:15.797253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 532/1074] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:15.801887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5838ef7-a93f-4358-8773-c2c3cab9e16f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.875054 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.890483 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c82f95-506d-4d41-9b14-1fcb28f09ccf None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.909942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5838ef7-a93f-4358-8773-c2c3cab9e16f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:15.930463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6bb80-f7d7-46ef-b574-d289652b66a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.931788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6bb80-f7d7-46ef-b574-d289652b66a5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.932228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6bb80-f7d7-46ef-b574-d289652b66a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.932495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f6bb80-f7d7-46ef-b574-d289652b66a5 None admin] PATH_INFO: `/v3/users/1ba35d5a932142f188f716bedd90074e` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.933702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6bb80-f7d7-46ef-b574-d289652b66a5 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba35d5a932142f188f716bedd90074e)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.935204 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f6bb80-f7d7-46ef-b574-d289652b66a5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.936968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 543/1075] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/users/1ba35d5a932142f188f716bedd90074e => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:15.943551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6bb80-f7d7-46ef-b574-d289652b66a5 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:15.948833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2221d-9a25-4c1c-a4a4-cbdc0f77ee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:15.949500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2221d-9a25-4c1c-a4a4-cbdc0f77ee50 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:15.949787 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2221d-9a25-4c1c-a4a4-cbdc0f77ee50 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:15.950065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2221d-9a25-4c1c-a4a4-cbdc0f77ee50 None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:15.950853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2221d-9a25-4c1c-a4a4-cbdc0f77ee50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:15.951194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2221d-9a25-4c1c-a4a4-cbdc0f77ee50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:15.952624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2221d-9a25-4c1c-a4a4-cbdc0f77ee50 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:15.966689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 533/1076] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:15.968504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:15.972991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2221d-9a25-4c1c-a4a4-cbdc0f77ee50 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:16.051232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f6bb80-f7d7-46ef-b574-d289652b66a5 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:16.083249 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2221d-9a25-4c1c-a4a4-cbdc0f77ee50 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:16.085165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f9ba7-eef8-4c14-96e3-69758c231a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:16.086104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9ba7-eef8-4c14-96e3-69758c231a50 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:16.086388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9ba7-eef8-4c14-96e3-69758c231a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:16.086664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f9ba7-eef8-4c14-96e3-69758c231a50 None admin] PATH_INFO: `/v3/projects/168b73ab730149f6abbe36ba7281d857` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:16.088148 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f9ba7-eef8-4c14-96e3-69758c231a50 None admin] RBAC: Authorizing `identity:get_project(project_id=168b73ab730149f6abbe36ba7281d857)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:16.089609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800f9ba7-eef8-4c14-96e3-69758c231a50 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:16.096349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 544/1077] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:15 2022] GET /identity/v3/projects/168b73ab730149f6abbe36ba7281d857 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:16.097236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f9ba7-eef8-4c14-96e3-69758c231a50 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:16.119439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:16.127880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be1d56-2a4f-45e9-bab6-416e58b6fb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:16.128777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be1d56-2a4f-45e9-bab6-416e58b6fb1c None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:16.129075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be1d56-2a4f-45e9-bab6-416e58b6fb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:16.129382 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be1d56-2a4f-45e9-bab6-416e58b6fb1c None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/5a82fed4ff8845919b1da05f7e8d1d72/roles/683c59f919e14e338161fe36d0f44320` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:16.131631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be1d56-2a4f-45e9-bab6-416e58b6fb1c None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=5a82fed4ff8845919b1da05f7e8d1d72, role_id=683c59f919e14e338161fe36d0f44320)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:16.133087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92be1d56-2a4f-45e9-bab6-416e58b6fb1c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:16.148404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 534/1078] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:06:15 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/5a82fed4ff8845919b1da05f7e8d1d72/roles/683c59f919e14e338161fe36d0f44320 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:06:16.200483 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:16.222106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f9ba7-eef8-4c14-96e3-69758c231a50 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:16.258427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0ad52e-4c1b-4be9-a9a9-ad2a8ad1c893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:16.259419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ad52e-4c1b-4be9-a9a9-ad2a8ad1c893 None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:16.259701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ad52e-4c1b-4be9-a9a9-ad2a8ad1c893 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:16.259974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0ad52e-4c1b-4be9-a9a9-ad2a8ad1c893 None admin] PATH_INFO: `/v3/projects/168b73ab730149f6abbe36ba7281d857/users/1ba35d5a932142f188f716bedd90074e/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:16.262009 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ad52e-4c1b-4be9-a9a9-ad2a8ad1c893 None admin] RBAC: Authorizing `identity:create_grant(project_id=168b73ab730149f6abbe36ba7281d857, user_id=1ba35d5a932142f188f716bedd90074e, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:16.263524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0ad52e-4c1b-4be9-a9a9-ad2a8ad1c893 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:16.278735 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 545/1079] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:06:16 2022] PUT /identity/v3/projects/168b73ab730149f6abbe36ba7281d857/users/1ba35d5a932142f188f716bedd90074e/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:06:17.086400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d475-37d0-479b-9e19-e9c859d1edd4 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.086925 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d475-37d0-479b-9e19-e9c859d1edd4 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.087240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e9d475-37d0-479b-9e19-e9c859d1edd4 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.088767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 535/1080] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:17.093693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0cef-601d-4b29-b920-b039e0fc2a77 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.094102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0cef-601d-4b29-b920-b039e0fc2a77 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.094361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb0cef-601d-4b29-b920-b039e0fc2a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.111451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-08eb0cef-601d-4b29-b920-b039e0fc2a77 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:17.112640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-08eb0cef-601d-4b29-b920-b039e0fc2a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:17.179181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 546/1081] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:17.201189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9d475-37d0-479b-9e19-e9c859d1edd4 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:17.314349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e9d475-37d0-479b-9e19-e9c859d1edd4 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:17.349935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3e51e-c8b3-4f8c-afaf-a4939d3755d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:17.350505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3e51e-c8b3-4f8c-afaf-a4939d3755d4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.350789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3e51e-c8b3-4f8c-afaf-a4939d3755d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.351098 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb3e51e-c8b3-4f8c-afaf-a4939d3755d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.412306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:17.425438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3e51e-c8b3-4f8c-afaf-a4939d3755d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:17.426913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb3e51e-c8b3-4f8c-afaf-a4939d3755d4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:17.526079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 536/1082] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:17.531740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb0cef-601d-4b29-b920-b039e0fc2a77 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:17.610173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:17.635102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb0cef-601d-4b29-b920-b039e0fc2a77 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:17.669717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cf875-954b-4914-a513-cd36bdae5357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:17.670504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cf875-954b-4914-a513-cd36bdae5357 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.670789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cf875-954b-4914-a513-cd36bdae5357 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.671103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cf875-954b-4914-a513-cd36bdae5357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.682132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cf875-954b-4914-a513-cd36bdae5357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:17.683625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cf875-954b-4914-a513-cd36bdae5357 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-a70cf875-954b-4914-a513-cd36bdae5357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:17.701967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:17.702886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:17.709625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:17.709625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:17.709625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:17.709625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:17.709625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 547/1083] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:17.711176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3e51e-c8b3-4f8c-afaf-a4939d3755d4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:17.804946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:17.816189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb3e51e-c8b3-4f8c-afaf-a4939d3755d4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:17.850481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dc3841-d1c1-4622-9afe-c4e98783ab63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:17.851172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc3841-d1c1-4622-9afe-c4e98783ab63 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:17.851460 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc3841-d1c1-4622-9afe-c4e98783ab63 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:17.851742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dc3841-d1c1-4622-9afe-c4e98783ab63 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:17.852466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc3841-d1c1-4622-9afe-c4e98783ab63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:17.852778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc3841-d1c1-4622-9afe-c4e98783ab63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:17.854304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dc3841-d1c1-4622-9afe-c4e98783ab63 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:17.875537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 537/1084] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:18.193698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5648d-d838-4b2e-9042-69c9f50d3dd3 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.194166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5648d-d838-4b2e-9042-69c9f50d3dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.194256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5648d-d838-4b2e-9042-69c9f50d3dd3 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.195673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 548/1085] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:18.200885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d91c05-5600-4736-95b0-c217a8ef7c3a None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.201299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d91c05-5600-4736-95b0-c217a8ef7c3a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.201442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d91c05-5600-4736-95b0-c217a8ef7c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.218991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c4d91c05-5600-4736-95b0-c217a8ef7c3a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:18.220717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c4d91c05-5600-4736-95b0-c217a8ef7c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:18.284921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 538/1086] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:18.308635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5648d-d838-4b2e-9042-69c9f50d3dd3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.327921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03630dd2-7402-4d35-a0a2-660457ca0004 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.328222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03630dd2-7402-4d35-a0a2-660457ca0004 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.328493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03630dd2-7402-4d35-a0a2-660457ca0004 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.330209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 539/1087] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:06:18.335732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5d5cf-12af-4903-beb2-5eb1b44bf7e5 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.336018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5d5cf-12af-4903-beb2-5eb1b44bf7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.336298 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd5d5cf-12af-4903-beb2-5eb1b44bf7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.353516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-fbd5d5cf-12af-4903-beb2-5eb1b44bf7e5 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:18.354701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fbd5d5cf-12af-4903-beb2-5eb1b44bf7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:18.414825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5648d-d838-4b2e-9042-69c9f50d3dd3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.420817 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 540/1088] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:06:18.442566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.444821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5d5cf-12af-4903-beb2-5eb1b44bf7e5 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.448799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffec6d8-feef-40b8-883c-2c6349f1a314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.449598 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffec6d8-feef-40b8-883c-2c6349f1a314 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.449877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffec6d8-feef-40b8-883c-2c6349f1a314 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.450146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffec6d8-feef-40b8-883c-2c6349f1a314 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.456403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.460998 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffec6d8-feef-40b8-883c-2c6349f1a314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-7ffec6d8-feef-40b8-883c-2c6349f1a314 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:18.469377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:18.470905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:18.471887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 549/1089] 10.222.0.48 () {56 vars in 1120 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:18.476899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffec6d8-feef-40b8-883c-2c6349f1a314 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.546914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd5d5cf-12af-4903-beb2-5eb1b44bf7e5 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.575097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffec6d8-feef-40b8-883c-2c6349f1a314 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.581195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318484-025a-4ecf-a292-94871a5385b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.581987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318484-025a-4ecf-a292-94871a5385b7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.582272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318484-025a-4ecf-a292-94871a5385b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.582547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0318484-025a-4ecf-a292-94871a5385b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.592738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0318484-025a-4ecf-a292-94871a5385b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-e0318484-025a-4ecf-a292-94871a5385b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:18.600928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:18.602052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:18.603172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 541/1090] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:18.608068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318484-025a-4ecf-a292-94871a5385b7 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.613027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4673-2192-4c23-900c-69ae34355077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.613693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4673-2192-4c23-900c-69ae34355077 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.613977 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4673-2192-4c23-900c-69ae34355077 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.614259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4b4673-2192-4c23-900c-69ae34355077 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.615043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b4673-2192-4c23-900c-69ae34355077 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:18.615356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b4673-2192-4c23-900c-69ae34355077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.616742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4b4673-2192-4c23-900c-69ae34355077 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.630461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 550/1091] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:18.631663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4673-2192-4c23-900c-69ae34355077 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.676257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.684378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.709607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0318484-025a-4ecf-a292-94871a5385b7 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.731681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4b4673-2192-4c23-900c-69ae34355077 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.744299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78def6a0-93f0-42ec-ad52-32eccf24fce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.744981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78def6a0-93f0-42ec-ad52-32eccf24fce7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.745246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78def6a0-93f0-42ec-ad52-32eccf24fce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.745520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78def6a0-93f0-42ec-ad52-32eccf24fce7 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.746263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78def6a0-93f0-42ec-ad52-32eccf24fce7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:18.746572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78def6a0-93f0-42ec-ad52-32eccf24fce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.747991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78def6a0-93f0-42ec-ad52-32eccf24fce7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.756494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 542/1092] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:18.762096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78def6a0-93f0-42ec-ad52-32eccf24fce7 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.764680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065a5bd-43c9-4227-98f6-3ba93a165b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.765477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065a5bd-43c9-4227-98f6-3ba93a165b41 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.765758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065a5bd-43c9-4227-98f6-3ba93a165b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.766036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065a5bd-43c9-4227-98f6-3ba93a165b41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.777085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065a5bd-43c9-4227-98f6-3ba93a165b41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.778537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065a5bd-43c9-4227-98f6-3ba93a165b41 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-c065a5bd-43c9-4227-98f6-3ba93a165b41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:18.796107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:18.797175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:18.798207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:18.798207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:18.798207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:18.798207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:18.798207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 551/1093] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:18.803196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065a5bd-43c9-4227-98f6-3ba93a165b41 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.866171 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78def6a0-93f0-42ec-ad52-32eccf24fce7 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.895206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.900558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090214b5-cba5-49db-96ba-d687c2f48b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.901422 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090214b5-cba5-49db-96ba-d687c2f48b84 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.901708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090214b5-cba5-49db-96ba-d687c2f48b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.901988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090214b5-cba5-49db-96ba-d687c2f48b84 None admin] PATH_INFO: `/v3/users/1ba35d5a932142f188f716bedd90074e` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.903215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090214b5-cba5-49db-96ba-d687c2f48b84 None admin] RBAC: Authorizing `identity:get_user(user_id=1ba35d5a932142f188f716bedd90074e)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.903553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065a5bd-43c9-4227-98f6-3ba93a165b41 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:18.904653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090214b5-cba5-49db-96ba-d687c2f48b84 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.905835 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:18.906461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 543/1094] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/users/1ba35d5a932142f188f716bedd90074e => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:18.912463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090214b5-cba5-49db-96ba-d687c2f48b84 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:18.939533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aad190-280c-4b8d-81bd-63963beb2cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:18.940210 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aad190-280c-4b8d-81bd-63963beb2cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:18.940495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aad190-280c-4b8d-81bd-63963beb2cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:18.940774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aad190-280c-4b8d-81bd-63963beb2cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:18.941496 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aad190-280c-4b8d-81bd-63963beb2cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:18.941808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aad190-280c-4b8d-81bd-63963beb2cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:18.943224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aad190-280c-4b8d-81bd-63963beb2cc7 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:18.954835 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 552/1095] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:18.960508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aad190-280c-4b8d-81bd-63963beb2cc7 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.012369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090214b5-cba5-49db-96ba-d687c2f48b84 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.045319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42fd52-d679-4fb6-8500-145f5c1a8461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.045967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42fd52-d679-4fb6-8500-145f5c1a8461 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.046256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42fd52-d679-4fb6-8500-145f5c1a8461 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.046531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42fd52-d679-4fb6-8500-145f5c1a8461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.057645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aad190-280c-4b8d-81bd-63963beb2cc7 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.096439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d4de4-9540-4a4f-84dc-f991d54ffd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.097482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d4de4-9540-4a4f-84dc-f991d54ffd2d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.097765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d4de4-9540-4a4f-84dc-f991d54ffd2d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.098041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7d4de4-9540-4a4f-84dc-f991d54ffd2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.105182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d4de4-9540-4a4f-84dc-f991d54ffd2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.106646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7d4de4-9540-4a4f-84dc-f991d54ffd2d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.113027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.115267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42fd52-d679-4fb6-8500-145f5c1a8461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.116775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42fd52-d679-4fb6-8500-145f5c1a8461 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-4c7d4de4-9540-4a4f-84dc-f991d54ffd2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:06:19.124388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:19.125344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:19.127650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 553/1096] 10.222.0.48 () {56 vars in 1093 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:06:19.131880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d4de4-9540-4a4f-84dc-f991d54ffd2d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.156063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.222992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 544/1097] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 04:06:19.228687 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42fd52-d679-4fb6-8500-145f5c1a8461 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.232917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7d4de4-9540-4a4f-84dc-f991d54ffd2d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.269313 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019360f4-171d-475b-a720-109974782e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.269982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019360f4-171d-475b-a720-109974782e29 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.270266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019360f4-171d-475b-a720-109974782e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.270540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019360f4-171d-475b-a720-109974782e29 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.271403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019360f4-171d-475b-a720-109974782e29 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:19.271713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019360f4-171d-475b-a720-109974782e29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.273149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019360f4-171d-475b-a720-109974782e29 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.290760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 554/1098] 10.222.0.48 () {56 vars in 1133 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:19.296401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019360f4-171d-475b-a720-109974782e29 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.322519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.326037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42fd52-d679-4fb6-8500-145f5c1a8461 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.361581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c454e-95a2-4dbc-8efb-f8400a9113d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.362433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c454e-95a2-4dbc-8efb-f8400a9113d7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.362712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c454e-95a2-4dbc-8efb-f8400a9113d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.363013 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712c454e-95a2-4dbc-8efb-f8400a9113d7 None admin] PATH_INFO: `/v3/projects/168b73ab730149f6abbe36ba7281d857` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.364199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c454e-95a2-4dbc-8efb-f8400a9113d7 None admin] RBAC: Authorizing `identity:get_project(project_id=168b73ab730149f6abbe36ba7281d857)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.365645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712c454e-95a2-4dbc-8efb-f8400a9113d7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.367384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 545/1099] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/projects/168b73ab730149f6abbe36ba7281d857 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:19.373333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c454e-95a2-4dbc-8efb-f8400a9113d7 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.380137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.398863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019360f4-171d-475b-a720-109974782e29 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.432502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febcd31-b069-4038-8959-1d55073a4efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.433145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febcd31-b069-4038-8959-1d55073a4efe None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.433423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febcd31-b069-4038-8959-1d55073a4efe None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.433696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3febcd31-b069-4038-8959-1d55073a4efe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.472080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712c454e-95a2-4dbc-8efb-f8400a9113d7 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.499740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febcd31-b069-4038-8959-1d55073a4efe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.501190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3febcd31-b069-4038-8959-1d55073a4efe None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.506595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34e115-fc77-4627-84bc-ca62d4836abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.507266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34e115-fc77-4627-84bc-ca62d4836abd None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.507546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34e115-fc77-4627-84bc-ca62d4836abd None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.507815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d34e115-fc77-4627-84bc-ca62d4836abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.508631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34e115-fc77-4627-84bc-ca62d4836abd None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=168b73ab730149f6abbe36ba7281d857, user.id=1ba35d5a932142f188f716bedd90074e) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:19.508937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34e115-fc77-4627-84bc-ca62d4836abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.510347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d34e115-fc77-4627-84bc-ca62d4836abd None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.516081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 546/1100] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/role_assignments?user.id=1ba35d5a932142f188f716bedd90074e&scope.project.id=168b73ab730149f6abbe36ba7281d857&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:19.589965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.611614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 555/1101] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 21 04:06:19.617911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34e115-fc77-4627-84bc-ca62d4836abd None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.652379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:19.725175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d34e115-fc77-4627-84bc-ca62d4836abd None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.758246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f47fe-6a4b-44d8-ab6a-c0321f3f5a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.758967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f47fe-6a4b-44d8-ab6a-c0321f3f5a0c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.759262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f47fe-6a4b-44d8-ab6a-c0321f3f5a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.759535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37f47fe-6a4b-44d8-ab6a-c0321f3f5a0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.769798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f47fe-6a4b-44d8-ab6a-c0321f3f5a0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.771270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37f47fe-6a4b-44d8-ab6a-c0321f3f5a0c None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f37f47fe-6a4b-44d8-ab6a-c0321f3f5a0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:19.788365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:19.789478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:19.790415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:06:19.790415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:19.790415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:06:19.790415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:19.790415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 547/1102] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:19.795276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febcd31-b069-4038-8959-1d55073a4efe None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:19.896562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3febcd31-b069-4038-8959-1d55073a4efe None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:19.931863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67564117-9c24-40fc-9c19-0f5de23e4d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:19.932526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67564117-9c24-40fc-9c19-0f5de23e4d0c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:19.932815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67564117-9c24-40fc-9c19-0f5de23e4d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:19.933090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67564117-9c24-40fc-9c19-0f5de23e4d0c None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:19.933807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67564117-9c24-40fc-9c19-0f5de23e4d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:19.934113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67564117-9c24-40fc-9c19-0f5de23e4d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:19.935532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67564117-9c24-40fc-9c19-0f5de23e4d0c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:19.947410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 556/1103] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:19.952977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f47fe-6a4b-44d8-ab6a-c0321f3f5a0c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:20.037867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:20.054005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37f47fe-6a4b-44d8-ab6a-c0321f3f5a0c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:20.086835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6790c2-890f-4254-b5c5-54f47ed8b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:20.087893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6790c2-890f-4254-b5c5-54f47ed8b0dc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.088169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6790c2-890f-4254-b5c5-54f47ed8b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.088438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6790c2-890f-4254-b5c5-54f47ed8b0dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.095490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6790c2-890f-4254-b5c5-54f47ed8b0dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:20.097038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6790c2-890f-4254-b5c5-54f47ed8b0dc None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-1c6790c2-890f-4254-b5c5-54f47ed8b0dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:06:20.110950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:20.112146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:20.113076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:06:20.113076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:06:20.113076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:20.113076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:20.113076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:20.113076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:20.113076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:06:20.113076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:20.113076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 548/1104] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:06:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:20.117921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67564117-9c24-40fc-9c19-0f5de23e4d0c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:20.161229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:20.218071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67564117-9c24-40fc-9c19-0f5de23e4d0c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:20.251267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9834537-f5ee-4b48-a97e-00471a63f73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:20.252001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9834537-f5ee-4b48-a97e-00471a63f73a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.252286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9834537-f5ee-4b48-a97e-00471a63f73a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.252562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9834537-f5ee-4b48-a97e-00471a63f73a None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.253356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9834537-f5ee-4b48-a97e-00471a63f73a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:20.253664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9834537-f5ee-4b48-a97e-00471a63f73a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:20.255137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9834537-f5ee-4b48-a97e-00471a63f73a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:20.267652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 557/1105] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:06:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:20.273576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6790c2-890f-4254-b5c5-54f47ed8b0dc None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:20.371463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6790c2-890f-4254-b5c5-54f47ed8b0dc None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:20.404438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378975a6-a740-40ce-a2f0-dff4cc051820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:20.405075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378975a6-a740-40ce-a2f0-dff4cc051820 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:20.405359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378975a6-a740-40ce-a2f0-dff4cc051820 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:20.405635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378975a6-a740-40ce-a2f0-dff4cc051820 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:20.406459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378975a6-a740-40ce-a2f0-dff4cc051820 None admin] RBAC: Adding query filter params (role.id=683c59f919e14e338161fe36d0f44320, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=5a82fed4ff8845919b1da05f7e8d1d72) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:20.406770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378975a6-a740-40ce-a2f0-dff4cc051820 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:20.408336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378975a6-a740-40ce-a2f0-dff4cc051820 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:20.414173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 549/1106] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:20 2022] GET /identity/v3/role_assignments?user.id=5a82fed4ff8845919b1da05f7e8d1d72&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=683c59f919e14e338161fe36d0f44320 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:21.598573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8189-f8f1-4046-95f0-c8c75e46f80b None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:21.599102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8189-f8f1-4046-95f0-c8c75e46f80b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:21.599102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d8189-f8f1-4046-95f0-c8c75e46f80b None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:21.600446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 558/1107] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:21.605671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb091e-c1f2-472c-ab7b-5ad013d56aec None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:21.606044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb091e-c1f2-472c-ab7b-5ad013d56aec None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:21.606236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb091e-c1f2-472c-ab7b-5ad013d56aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:21.622690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-ddeb091e-c1f2-472c-ab7b-5ad013d56aec None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:21.623898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ddeb091e-c1f2-472c-ab7b-5ad013d56aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:21.625793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:21.691592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 550/1108] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:21.716845 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d8189-f8f1-4046-95f0-c8c75e46f80b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:21.814546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d8189-f8f1-4046-95f0-c8c75e46f80b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:21.816047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:21.850182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47eaa6-61a6-4598-bf8c-00e7541624cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:21.850905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47eaa6-61a6-4598-bf8c-00e7541624cb None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:21.851214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47eaa6-61a6-4598-bf8c-00e7541624cb None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:21.851489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47eaa6-61a6-4598-bf8c-00e7541624cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:21.852645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47eaa6-61a6-4598-bf8c-00e7541624cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:21.854081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f47eaa6-61a6-4598-bf8c-00e7541624cb None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:21.860320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 559/1109] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:21.861520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb091e-c1f2-472c-ab7b-5ad013d56aec None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:21.956897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb091e-c1f2-472c-ab7b-5ad013d56aec None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:21.989328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1c8817-7118-4fe3-93dc-ad60d0d43d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:21.989982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c8817-7118-4fe3-93dc-ad60d0d43d43 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:21.990268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c8817-7118-4fe3-93dc-ad60d0d43d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:21.990547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1c8817-7118-4fe3-93dc-ad60d0d43d43 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:21.991274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c8817-7118-4fe3-93dc-ad60d0d43d43 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:21.992709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1c8817-7118-4fe3-93dc-ad60d0d43d43 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:22.001545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:22.013664 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 551/1110] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:06:21 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:24.123679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817111cd-1fa1-4cac-be05-2b4f8b5e6101 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:24.124209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817111cd-1fa1-4cac-be05-2b4f8b5e6101 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:24.124326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817111cd-1fa1-4cac-be05-2b4f8b5e6101 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:24.125607 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 560/1111] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:24.131877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351d2f9-ad3a-49fb-ac7a-68cd2dfb86d5 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:24.132278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351d2f9-ad3a-49fb-ac7a-68cd2dfb86d5 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:24.132432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351d2f9-ad3a-49fb-ac7a-68cd2dfb86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:24.149401 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-a351d2f9-ad3a-49fb-ac7a-68cd2dfb86d5 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:24.150584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a351d2f9-ad3a-49fb-ac7a-68cd2dfb86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:24.215994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 552/1112] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:24.240083 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817111cd-1fa1-4cac-be05-2b4f8b5e6101 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:24.338121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817111cd-1fa1-4cac-be05-2b4f8b5e6101 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:24.371410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5771b8-3373-4ee0-bee0-a8b3b32e9f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:24.372249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5771b8-3373-4ee0-bee0-a8b3b32e9f75 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:24.372530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5771b8-3373-4ee0-bee0-a8b3b32e9f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:24.372802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5771b8-3373-4ee0-bee0-a8b3b32e9f75 None admin] PATH_INFO: `/v3/roles/b29b8d5f31b44d8b90eb10c34acbc06a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:24.374411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5771b8-3373-4ee0-bee0-a8b3b32e9f75 None admin] RBAC: Authorizing `identity:get_role(role_id=b29b8d5f31b44d8b90eb10c34acbc06a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:24.375817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5771b8-3373-4ee0-bee0-a8b3b32e9f75 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:24.377629 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 561/1113] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:24 2022] GET /identity/v3/roles/b29b8d5f31b44d8b90eb10c34acbc06a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:24.383357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351d2f9-ad3a-49fb-ac7a-68cd2dfb86d5 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:24.479889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351d2f9-ad3a-49fb-ac7a-68cd2dfb86d5 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:24.502912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:24.514107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa41fc-babc-459f-abf4-31f05eee2e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:24.514981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa41fc-babc-459f-abf4-31f05eee2e5a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:24.515273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa41fc-babc-459f-abf4-31f05eee2e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:24.515552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa41fc-babc-459f-abf4-31f05eee2e5a None admin] PATH_INFO: `/v3/users/9a69605f9102448db0e0e891eb46420b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:24.528822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa41fc-babc-459f-abf4-31f05eee2e5a None admin] RBAC: Authorizing `identity:get_user(user_id=9a69605f9102448db0e0e891eb46420b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:24.530272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aaa41fc-babc-459f-abf4-31f05eee2e5a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:24.531948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 553/1114] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:24 2022] GET /identity/v3/users/9a69605f9102448db0e0e891eb46420b => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:24.538133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5771b8-3373-4ee0-bee0-a8b3b32e9f75 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:24.578125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:24.637680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5771b8-3373-4ee0-bee0-a8b3b32e9f75 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:24.670441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44148000-259b-49e6-b0f8-2cc0e29d3495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:24.671100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44148000-259b-49e6-b0f8-2cc0e29d3495 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:24.671383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44148000-259b-49e6-b0f8-2cc0e29d3495 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:24.671658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44148000-259b-49e6-b0f8-2cc0e29d3495 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:24.738933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44148000-259b-49e6-b0f8-2cc0e29d3495 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:24.740417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44148000-259b-49e6-b0f8-2cc0e29d3495 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:24.780110 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:24.838793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 562/1115] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:24.845438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa41fc-babc-459f-abf4-31f05eee2e5a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:24.945086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa41fc-babc-459f-abf4-31f05eee2e5a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:24.977341 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccca09c-dbaa-4a54-ac40-0292833bcd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:24.978173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca09c-dbaa-4a54-ac40-0292833bcd49 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:24.978453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca09c-dbaa-4a54-ac40-0292833bcd49 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:24.978722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccca09c-dbaa-4a54-ac40-0292833bcd49 None admin] PATH_INFO: `/v3/projects/168b73ab730149f6abbe36ba7281d857` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:24.979904 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccca09c-dbaa-4a54-ac40-0292833bcd49 None admin] RBAC: Authorizing `identity:get_project(project_id=168b73ab730149f6abbe36ba7281d857)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:24.981331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccca09c-dbaa-4a54-ac40-0292833bcd49 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:24.983145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 554/1116] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:24 2022] GET /identity/v3/projects/168b73ab730149f6abbe36ba7281d857 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:24.989922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44148000-259b-49e6-b0f8-2cc0e29d3495 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:25.088292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44148000-259b-49e6-b0f8-2cc0e29d3495 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:25.121185 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6fea4-28ea-4322-ac4c-d5f7c8d089cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:25.121829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6fea4-28ea-4322-ac4c-d5f7c8d089cb None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:25.122109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6fea4-28ea-4322-ac4c-d5f7c8d089cb None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:25.122381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6fea4-28ea-4322-ac4c-d5f7c8d089cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:25.123231 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6fea4-28ea-4322-ac4c-d5f7c8d089cb None admin] RBAC: Adding query filter params (role.id=b29b8d5f31b44d8b90eb10c34acbc06a, scope.project.id=168b73ab730149f6abbe36ba7281d857, user.id=9a69605f9102448db0e0e891eb46420b) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:25.123539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6fea4-28ea-4322-ac4c-d5f7c8d089cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:25.124966 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6fea4-28ea-4322-ac4c-d5f7c8d089cb None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:25.130276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 563/1117] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:24 2022] GET /identity/v3/role_assignments?user.id=9a69605f9102448db0e0e891eb46420b&scope.project.id=168b73ab730149f6abbe36ba7281d857&role.id=b29b8d5f31b44d8b90eb10c34acbc06a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:27.119596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f87b3d-ee74-4cb8-9a81-0cc67c4516c3 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:27.121396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f87b3d-ee74-4cb8-9a81-0cc67c4516c3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:27.121396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f87b3d-ee74-4cb8-9a81-0cc67c4516c3 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:27.121592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 555/1118] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:27.127301 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2da41-67e9-4ad7-a3d4-da034015cbed None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:27.127716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2da41-67e9-4ad7-a3d4-da034015cbed None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:27.127855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2da41-67e9-4ad7-a3d4-da034015cbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:27.132798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:27.145903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-3ae2da41-67e9-4ad7-a3d4-da034015cbed None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:27.147129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3ae2da41-67e9-4ad7-a3d4-da034015cbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:27.213294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 564/1119] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:27.235928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f87b3d-ee74-4cb8-9a81-0cc67c4516c3 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:27.285957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:27.335864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f87b3d-ee74-4cb8-9a81-0cc67c4516c3 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:27.368151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca60d6-57d9-4f51-96c7-0c02f49c07f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:27.368985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca60d6-57d9-4f51-96c7-0c02f49c07f4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:27.369265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca60d6-57d9-4f51-96c7-0c02f49c07f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:27.369537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca60d6-57d9-4f51-96c7-0c02f49c07f4 None admin] PATH_INFO: `/v3/roles/b29b8d5f31b44d8b90eb10c34acbc06a` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:27.371118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca60d6-57d9-4f51-96c7-0c02f49c07f4 None admin] RBAC: Authorizing `identity:get_role(role_id=b29b8d5f31b44d8b90eb10c34acbc06a)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:27.372425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca60d6-57d9-4f51-96c7-0c02f49c07f4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:27.373771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 556/1120] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:27 2022] GET /identity/v3/roles/b29b8d5f31b44d8b90eb10c34acbc06a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:27.380099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2da41-67e9-4ad7-a3d4-da034015cbed None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:27.474747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2da41-67e9-4ad7-a3d4-da034015cbed None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:27.503074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:27.508196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257a272-24c1-4a6c-b6f9-b5318d9e3f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:27.509049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257a272-24c1-4a6c-b6f9-b5318d9e3f7e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:27.509324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257a272-24c1-4a6c-b6f9-b5318d9e3f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:27.509595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257a272-24c1-4a6c-b6f9-b5318d9e3f7e None admin] PATH_INFO: `/v3/users/9a69605f9102448db0e0e891eb46420b` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:27.510756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257a272-24c1-4a6c-b6f9-b5318d9e3f7e None admin] RBAC: Authorizing `identity:get_user(user_id=9a69605f9102448db0e0e891eb46420b)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:27.512223 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6257a272-24c1-4a6c-b6f9-b5318d9e3f7e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:27.513824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 565/1121] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:27 2022] GET /identity/v3/users/9a69605f9102448db0e0e891eb46420b => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:27.519724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca60d6-57d9-4f51-96c7-0c02f49c07f4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:27.618819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca60d6-57d9-4f51-96c7-0c02f49c07f4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:27.636136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:27.652837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eb15be-a2bf-4533-b5f5-33f46a3d537d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:27.653712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb15be-a2bf-4533-b5f5-33f46a3d537d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:27.653998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb15be-a2bf-4533-b5f5-33f46a3d537d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:27.654274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eb15be-a2bf-4533-b5f5-33f46a3d537d None admin] PATH_INFO: `/v3/projects/168b73ab730149f6abbe36ba7281d857` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:27.655470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb15be-a2bf-4533-b5f5-33f46a3d537d None admin] RBAC: Authorizing `identity:get_project(project_id=168b73ab730149f6abbe36ba7281d857)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:27.656961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eb15be-a2bf-4533-b5f5-33f46a3d537d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:27.659983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 557/1122] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:27 2022] GET /identity/v3/projects/168b73ab730149f6abbe36ba7281d857 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:27.665862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257a272-24c1-4a6c-b6f9-b5318d9e3f7e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:27.764779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6257a272-24c1-4a6c-b6f9-b5318d9e3f7e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:27.797317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4846ddaf-00a4-4ad3-99e3-df10ff492444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:27.799164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846ddaf-00a4-4ad3-99e3-df10ff492444 None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:27.799447 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846ddaf-00a4-4ad3-99e3-df10ff492444 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:27.799723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4846ddaf-00a4-4ad3-99e3-df10ff492444 None admin] PATH_INFO: `/v3/projects/168b73ab730149f6abbe36ba7281d857/users/9a69605f9102448db0e0e891eb46420b/roles/b29b8d5f31b44d8b90eb10c34acbc06a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:27.801925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846ddaf-00a4-4ad3-99e3-df10ff492444 None admin] RBAC: Authorizing `identity:create_grant(project_id=168b73ab730149f6abbe36ba7281d857, user_id=9a69605f9102448db0e0e891eb46420b, role_id=b29b8d5f31b44d8b90eb10c34acbc06a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:27.803397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4846ddaf-00a4-4ad3-99e3-df10ff492444 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:27.817362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 566/1123] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:06:27 2022] PUT /identity/v3/projects/168b73ab730149f6abbe36ba7281d857/users/9a69605f9102448db0e0e891eb46420b/roles/b29b8d5f31b44d8b90eb10c34acbc06a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:06:29.810977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f844a39-22b9-4380-bd91-33b7f9dde2a3 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:29.811535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f844a39-22b9-4380-bd91-33b7f9dde2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:29.811640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f844a39-22b9-4380-bd91-33b7f9dde2a3 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:29.812950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 558/1124] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:29.818716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8b4de-ef0e-474d-92b1-ad093554ad3f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:29.819172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8b4de-ef0e-474d-92b1-ad093554ad3f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:29.819300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8b4de-ef0e-474d-92b1-ad093554ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:29.835681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-35c8b4de-ef0e-474d-92b1-ad093554ad3f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:29.836856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-35c8b4de-ef0e-474d-92b1-ad093554ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:29.891538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:29.903187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 567/1125] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:29.927226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f844a39-22b9-4380-bd91-33b7f9dde2a3 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:30.026757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f844a39-22b9-4380-bd91-33b7f9dde2a3 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:30.059968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126fe3a-5216-401d-a82d-b70352f43181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:30.060808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126fe3a-5216-401d-a82d-b70352f43181 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.061142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126fe3a-5216-401d-a82d-b70352f43181 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.061370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126fe3a-5216-401d-a82d-b70352f43181 None admin] PATH_INFO: `/v3/roles/b29b8d5f31b44d8b90eb10c34acbc06a` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.062844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126fe3a-5216-401d-a82d-b70352f43181 None admin] RBAC: Authorizing `identity:get_role(role_id=b29b8d5f31b44d8b90eb10c34acbc06a)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:30.064815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126fe3a-5216-401d-a82d-b70352f43181 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:30.066169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 559/1126] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:29 2022] GET /identity/v3/roles/b29b8d5f31b44d8b90eb10c34acbc06a => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:30.071883 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8b4de-ef0e-474d-92b1-ad093554ad3f None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:30.166794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8b4de-ef0e-474d-92b1-ad093554ad3f None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:30.203054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62fce7-748c-4374-af05-70c3f5734de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:30.204524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62fce7-748c-4374-af05-70c3f5734de5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.204811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62fce7-748c-4374-af05-70c3f5734de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.205095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb62fce7-748c-4374-af05-70c3f5734de5 None admin] PATH_INFO: `/v3/users/9a69605f9102448db0e0e891eb46420b` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.206302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62fce7-748c-4374-af05-70c3f5734de5 None admin] RBAC: Authorizing `identity:get_user(user_id=9a69605f9102448db0e0e891eb46420b)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:30.207789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb62fce7-748c-4374-af05-70c3f5734de5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:30.209422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 568/1127] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:30 2022] GET /identity/v3/users/9a69605f9102448db0e0e891eb46420b => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:30.215294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126fe3a-5216-401d-a82d-b70352f43181 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:30.269924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:30.314577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126fe3a-5216-401d-a82d-b70352f43181 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:30.347514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc2034-ac92-433e-a4c8-22f71210a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:30.348153 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc2034-ac92-433e-a4c8-22f71210a5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.348440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc2034-ac92-433e-a4c8-22f71210a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.348721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc2034-ac92-433e-a4c8-22f71210a5f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.413314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc2034-ac92-433e-a4c8-22f71210a5f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:30.414765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efc2034-ac92-433e-a4c8-22f71210a5f0 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:30.466047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:30.511660 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 560/1128] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:30.518289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62fce7-748c-4374-af05-70c3f5734de5 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:30.574818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:30.616307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb62fce7-748c-4374-af05-70c3f5734de5 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:30.648805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ab7bd-63c9-4cc2-8adb-7a246d824104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:30.649650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab7bd-63c9-4cc2-8adb-7a246d824104 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.649936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab7bd-63c9-4cc2-8adb-7a246d824104 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.650213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ab7bd-63c9-4cc2-8adb-7a246d824104 None admin] PATH_INFO: `/v3/projects/168b73ab730149f6abbe36ba7281d857` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.651404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ab7bd-63c9-4cc2-8adb-7a246d824104 None admin] RBAC: Authorizing `identity:get_project(project_id=168b73ab730149f6abbe36ba7281d857)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:30.652844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ab7bd-63c9-4cc2-8adb-7a246d824104 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:30.654517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 569/1129] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:30 2022] GET /identity/v3/projects/168b73ab730149f6abbe36ba7281d857 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:30.661218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc2034-ac92-433e-a4c8-22f71210a5f0 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:30.756577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc2034-ac92-433e-a4c8-22f71210a5f0 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:30.790220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d789a0-8c4f-4ad1-9193-215f8cb1c3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:30.790857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d789a0-8c4f-4ad1-9193-215f8cb1c3bd None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:30.791173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d789a0-8c4f-4ad1-9193-215f8cb1c3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:30.791453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d789a0-8c4f-4ad1-9193-215f8cb1c3bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:30.792278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d789a0-8c4f-4ad1-9193-215f8cb1c3bd None admin] RBAC: Adding query filter params (role.id=b29b8d5f31b44d8b90eb10c34acbc06a, scope.project.id=168b73ab730149f6abbe36ba7281d857, user.id=9a69605f9102448db0e0e891eb46420b) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:30.792594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d789a0-8c4f-4ad1-9193-215f8cb1c3bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:30.794028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d789a0-8c4f-4ad1-9193-215f8cb1c3bd None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:30.799881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 561/1130] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:30 2022] GET /identity/v3/role_assignments?user.id=9a69605f9102448db0e0e891eb46420b&scope.project.id=168b73ab730149f6abbe36ba7281d857&role.id=b29b8d5f31b44d8b90eb10c34acbc06a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:32.814336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20b25f-47dd-48d3-b2f5-d984b28ec18e None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:32.814882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20b25f-47dd-48d3-b2f5-d984b28ec18e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:32.814882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20b25f-47dd-48d3-b2f5-d984b28ec18e None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:32.816286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 570/1131] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:32.821579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e855-2d89-4c98-a067-8f3947ee3366 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:32.821984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e855-2d89-4c98-a067-8f3947ee3366 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:32.822143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e855-2d89-4c98-a067-8f3947ee3366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:32.839055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-6b23e855-2d89-4c98-a067-8f3947ee3366 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:32.840263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6b23e855-2d89-4c98-a067-8f3947ee3366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:32.853790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:32.907868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 562/1132] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:32.931528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20b25f-47dd-48d3-b2f5-d984b28ec18e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:33.030860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20b25f-47dd-48d3-b2f5-d984b28ec18e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:33.055803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:33.065340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e976b9-b44f-4542-a577-2510f42ffe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:33.066060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e976b9-b44f-4542-a577-2510f42ffe90 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:33.066348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e976b9-b44f-4542-a577-2510f42ffe90 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:33.066624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e976b9-b44f-4542-a577-2510f42ffe90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:33.067826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e976b9-b44f-4542-a577-2510f42ffe90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:33.069277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e976b9-b44f-4542-a577-2510f42ffe90 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:33.070886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 571/1133] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:33.076684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23e855-2d89-4c98-a067-8f3947ee3366 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:33.172922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23e855-2d89-4c98-a067-8f3947ee3366 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:33.209064 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e93fe6-f49c-4e7d-9296-bd66cd142420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:33.209724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e93fe6-f49c-4e7d-9296-bd66cd142420 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:33.210110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e93fe6-f49c-4e7d-9296-bd66cd142420 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:33.210385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e93fe6-f49c-4e7d-9296-bd66cd142420 None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:33.211126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e93fe6-f49c-4e7d-9296-bd66cd142420 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:33.212825 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e93fe6-f49c-4e7d-9296-bd66cd142420 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:33.232683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:33.240600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 563/1134] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:33 2022] POST /identity/v3/projects => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:35.295727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb7042-c9b2-4d1b-8ec1-d192a0784d52 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.296290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb7042-c9b2-4d1b-8ec1-d192a0784d52 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.296290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb7042-c9b2-4d1b-8ec1-d192a0784d52 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.297641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 572/1135] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:35.303042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953156f-ec80-457a-9047-3257f5cde410 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.303417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953156f-ec80-457a-9047-3257f5cde410 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.303601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d953156f-ec80-457a-9047-3257f5cde410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.320551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d953156f-ec80-457a-9047-3257f5cde410 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:35.321744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d953156f-ec80-457a-9047-3257f5cde410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:35.388607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 564/1136] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:35.413726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb7042-c9b2-4d1b-8ec1-d192a0784d52 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:35.511620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb7042-c9b2-4d1b-8ec1-d192a0784d52 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:35.543938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df240602-e098-48a8-9628-fb6f4c87c736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:35.544709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240602-e098-48a8-9628-fb6f4c87c736 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.544988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240602-e098-48a8-9628-fb6f4c87c736 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.545261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df240602-e098-48a8-9628-fb6f4c87c736 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.546399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df240602-e098-48a8-9628-fb6f4c87c736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:35.548509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df240602-e098-48a8-9628-fb6f4c87c736 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:35.550084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 573/1137] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:06:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:35.555696 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953156f-ec80-457a-9047-3257f5cde410 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:35.652060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d953156f-ec80-457a-9047-3257f5cde410 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:35.680321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:35.686405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c158ba-ae9f-4f11-901c-8e115f2b2150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:35.687098 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c158ba-ae9f-4f11-901c-8e115f2b2150 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:35.687381 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c158ba-ae9f-4f11-901c-8e115f2b2150 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:35.688188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c158ba-ae9f-4f11-901c-8e115f2b2150 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:35.689068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c158ba-ae9f-4f11-901c-8e115f2b2150 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:35.690505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c158ba-ae9f-4f11-901c-8e115f2b2150 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:35.709537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 565/1138] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:06:35 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:06:37.906122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c716451-caab-4a8c-8c70-88b76061fbb6 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:37.906678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c716451-caab-4a8c-8c70-88b76061fbb6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:37.906678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c716451-caab-4a8c-8c70-88b76061fbb6 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:37.908088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 574/1139] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:37.913543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe9f50-ac44-44a5-9522-10220044acf0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:37.913978 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe9f50-ac44-44a5-9522-10220044acf0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:37.914103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe9f50-ac44-44a5-9522-10220044acf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:37.930588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-17fe9f50-ac44-44a5-9522-10220044acf0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:37.931816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-17fe9f50-ac44-44a5-9522-10220044acf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:37.997392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 566/1140] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:38.021273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c716451-caab-4a8c-8c70-88b76061fbb6 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:38.082376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:38.121667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c716451-caab-4a8c-8c70-88b76061fbb6 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:38.154435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a0f2b-a1d2-46d2-af2b-0f6bd3f7f748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:38.155240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a0f2b-a1d2-46d2-af2b-0f6bd3f7f748 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:38.155525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a0f2b-a1d2-46d2-af2b-0f6bd3f7f748 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:38.155800 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a0f2b-a1d2-46d2-af2b-0f6bd3f7f748 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:38.166186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a0f2b-a1d2-46d2-af2b-0f6bd3f7f748 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-e97a0f2b-a1d2-46d2-af2b-0f6bd3f7f748 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:38.173922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:38.175114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:38.176056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 575/1141] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:38.181117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe9f50-ac44-44a5-9522-10220044acf0 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:38.278181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe9f50-ac44-44a5-9522-10220044acf0 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:38.294543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:38.312773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036786b-4a29-45c3-94c0-7791277b54e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:38.313440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036786b-4a29-45c3-94c0-7791277b54e2 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:38.313730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036786b-4a29-45c3-94c0-7791277b54e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:38.314011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036786b-4a29-45c3-94c0-7791277b54e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:38.314755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036786b-4a29-45c3-94c0-7791277b54e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:38.315092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036786b-4a29-45c3-94c0-7791277b54e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:38.316480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d036786b-4a29-45c3-94c0-7791277b54e2 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:38.324337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 567/1142] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:38.330798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a0f2b-a1d2-46d2-af2b-0f6bd3f7f748 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:38.429256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a0f2b-a1d2-46d2-af2b-0f6bd3f7f748 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:38.451170 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:38.463134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaad376-28d5-4863-940b-c0f14c347a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:38.464001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad376-28d5-4863-940b-c0f14c347a64 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:38.464288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad376-28d5-4863-940b-c0f14c347a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:38.464567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaad376-28d5-4863-940b-c0f14c347a64 None admin] PATH_INFO: `/v3/users/43cd1397229241048a28efdaf3ff9a95` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:38.478217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaad376-28d5-4863-940b-c0f14c347a64 None admin] RBAC: Authorizing `identity:get_user(user_id=43cd1397229241048a28efdaf3ff9a95)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:38.479689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaad376-28d5-4863-940b-c0f14c347a64 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:38.481339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 576/1143] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:38 2022] GET /identity/v3/users/43cd1397229241048a28efdaf3ff9a95 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:38.487877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036786b-4a29-45c3-94c0-7791277b54e2 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:38.585507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d036786b-4a29-45c3-94c0-7791277b54e2 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:38.620049 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb6660-b555-4604-974b-0b4d067418ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:38.620687 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb6660-b555-4604-974b-0b4d067418ab None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:38.620973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb6660-b555-4604-974b-0b4d067418ab None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:38.621253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb6660-b555-4604-974b-0b4d067418ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:38.675986 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:38.707379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb6660-b555-4604-974b-0b4d067418ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:38.708766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb6660-b555-4604-974b-0b4d067418ab None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:38.808345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 568/1144] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:38.815084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaad376-28d5-4863-940b-c0f14c347a64 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:38.915995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaad376-28d5-4863-940b-c0f14c347a64 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:38.949300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e089f3-0237-4120-9758-cb5105daa372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:38.950145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e089f3-0237-4120-9758-cb5105daa372 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:38.950423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e089f3-0237-4120-9758-cb5105daa372 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:38.950693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e089f3-0237-4120-9758-cb5105daa372 None admin] PATH_INFO: `/v3/projects/ca0bbc4ba1434c58915e64fa344df080` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:38.951868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e089f3-0237-4120-9758-cb5105daa372 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0bbc4ba1434c58915e64fa344df080)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:38.953480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e089f3-0237-4120-9758-cb5105daa372 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:38.955188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 577/1145] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:38 2022] GET /identity/v3/projects/ca0bbc4ba1434c58915e64fa344df080 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:38.961455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb6660-b555-4604-974b-0b4d067418ab None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:39.036273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:39.057755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb6660-b555-4604-974b-0b4d067418ab None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:39.092019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27780364-c542-495b-94be-2bfbafc25345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:39.092662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27780364-c542-495b-94be-2bfbafc25345 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:39.092949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27780364-c542-495b-94be-2bfbafc25345 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:39.093227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27780364-c542-495b-94be-2bfbafc25345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:39.094626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27780364-c542-495b-94be-2bfbafc25345 None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=ca0bbc4ba1434c58915e64fa344df080, user.id=43cd1397229241048a28efdaf3ff9a95) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:39.094943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27780364-c542-495b-94be-2bfbafc25345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:39.096411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27780364-c542-495b-94be-2bfbafc25345 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:39.101735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 569/1146] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:38 2022] GET /identity/v3/role_assignments?user.id=43cd1397229241048a28efdaf3ff9a95&scope.project.id=ca0bbc4ba1434c58915e64fa344df080&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:41.102000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd9fce-2efb-464c-a3cf-b5e4f8a265cd None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:41.102552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd9fce-2efb-464c-a3cf-b5e4f8a265cd None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:41.102552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd9fce-2efb-464c-a3cf-b5e4f8a265cd None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:41.104149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 578/1147] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:41.109373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b94dd-bd9b-41fe-9710-4bb4f7e078fa None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:41.109894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b94dd-bd9b-41fe-9710-4bb4f7e078fa None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:41.109985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b94dd-bd9b-41fe-9710-4bb4f7e078fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:41.126227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-101b94dd-bd9b-41fe-9710-4bb4f7e078fa None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:41.127429 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-101b94dd-bd9b-41fe-9710-4bb4f7e078fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:41.191932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 570/1148] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:41.214904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd9fce-2efb-464c-a3cf-b5e4f8a265cd None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:41.264852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:41.315347 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd9fce-2efb-464c-a3cf-b5e4f8a265cd None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:41.352375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e1f42-ff8a-48bb-b3af-41f94f934f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:41.353079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1f42-ff8a-48bb-b3af-41f94f934f0a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:41.353358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1f42-ff8a-48bb-b3af-41f94f934f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:41.353633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e1f42-ff8a-48bb-b3af-41f94f934f0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:41.363977 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e1f42-ff8a-48bb-b3af-41f94f934f0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-454e1f42-ff8a-48bb-b3af-41f94f934f0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:41.375370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:41.376514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:41.377637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 579/1149] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:41.382738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b94dd-bd9b-41fe-9710-4bb4f7e078fa None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:41.451129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:41.480247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b94dd-bd9b-41fe-9710-4bb4f7e078fa None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:41.512897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1a314-8a80-4b19-934c-31ff29fa55c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:41.513552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1a314-8a80-4b19-934c-31ff29fa55c0 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:41.513838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1a314-8a80-4b19-934c-31ff29fa55c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:41.514115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1a314-8a80-4b19-934c-31ff29fa55c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:41.514855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1a314-8a80-4b19-934c-31ff29fa55c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:41.515197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1a314-8a80-4b19-934c-31ff29fa55c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:41.516718 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1a314-8a80-4b19-934c-31ff29fa55c0 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:41.524581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 571/1150] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:41.530450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e1f42-ff8a-48bb-b3af-41f94f934f0a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:41.627451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e1f42-ff8a-48bb-b3af-41f94f934f0a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:41.635924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:41.661699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76335c40-0dd6-4ec1-bab6-069b075367ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:41.662576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76335c40-0dd6-4ec1-bab6-069b075367ae None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:41.662862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76335c40-0dd6-4ec1-bab6-069b075367ae None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:41.663167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76335c40-0dd6-4ec1-bab6-069b075367ae None admin] PATH_INFO: `/v3/users/43cd1397229241048a28efdaf3ff9a95` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:41.664364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76335c40-0dd6-4ec1-bab6-069b075367ae None admin] RBAC: Authorizing `identity:get_user(user_id=43cd1397229241048a28efdaf3ff9a95)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:41.665809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76335c40-0dd6-4ec1-bab6-069b075367ae None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:41.667493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 580/1151] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:41 2022] GET /identity/v3/users/43cd1397229241048a28efdaf3ff9a95 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:41.674324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1a314-8a80-4b19-934c-31ff29fa55c0 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:41.774098 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1a314-8a80-4b19-934c-31ff29fa55c0 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:41.806132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad337f28-ecd5-4c15-a3dd-f6451f53710a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:41.806991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad337f28-ecd5-4c15-a3dd-f6451f53710a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:41.807275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad337f28-ecd5-4c15-a3dd-f6451f53710a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:41.807547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad337f28-ecd5-4c15-a3dd-f6451f53710a None admin] PATH_INFO: `/v3/projects/ca0bbc4ba1434c58915e64fa344df080` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:41.808707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad337f28-ecd5-4c15-a3dd-f6451f53710a None admin] RBAC: Authorizing `identity:get_project(project_id=ca0bbc4ba1434c58915e64fa344df080)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:41.810135 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad337f28-ecd5-4c15-a3dd-f6451f53710a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:41.811836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 572/1152] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:41 2022] GET /identity/v3/projects/ca0bbc4ba1434c58915e64fa344df080 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:41.818074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76335c40-0dd6-4ec1-bab6-069b075367ae None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:41.916305 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76335c40-0dd6-4ec1-bab6-069b075367ae None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:41.948015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c37258-4d9c-4101-9e37-b72a5541d218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:41.948885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c37258-4d9c-4101-9e37-b72a5541d218 None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:41.949169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c37258-4d9c-4101-9e37-b72a5541d218 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:41.949444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c37258-4d9c-4101-9e37-b72a5541d218 None admin] PATH_INFO: `/v3/projects/ca0bbc4ba1434c58915e64fa344df080/users/43cd1397229241048a28efdaf3ff9a95/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:41.951419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c37258-4d9c-4101-9e37-b72a5541d218 None admin] RBAC: Authorizing `identity:create_grant(project_id=ca0bbc4ba1434c58915e64fa344df080, user_id=43cd1397229241048a28efdaf3ff9a95, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:41.953383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c37258-4d9c-4101-9e37-b72a5541d218 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:41.967116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 581/1153] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:06:41 2022] PUT /identity/v3/projects/ca0bbc4ba1434c58915e64fa344df080/users/43cd1397229241048a28efdaf3ff9a95/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:06:43.962942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4392d-71bc-49c2-9b03-791036d88335 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:43.963494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4392d-71bc-49c2-9b03-791036d88335 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:43.963604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4392d-71bc-49c2-9b03-791036d88335 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:43.964897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 573/1154] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:43.970828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ba6d-898c-433d-a754-32511c2e29e6 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:43.971230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ba6d-898c-433d-a754-32511c2e29e6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:43.971406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311ba6d-898c-433d-a754-32511c2e29e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:43.988814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1311ba6d-898c-433d-a754-32511c2e29e6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:43.989988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1311ba6d-898c-433d-a754-32511c2e29e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:44.019070 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:44.056995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 582/1155] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:44.080542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4392d-71bc-49c2-9b03-791036d88335 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:44.083417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:44.180648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4392d-71bc-49c2-9b03-791036d88335 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:44.215625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45c61-982f-4f25-a78c-df613ce2c4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:44.216353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45c61-982f-4f25-a78c-df613ce2c4ee None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:44.216637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45c61-982f-4f25-a78c-df613ce2c4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:44.216917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf45c61-982f-4f25-a78c-df613ce2c4ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:44.228033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf45c61-982f-4f25-a78c-df613ce2c4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0cf45c61-982f-4f25-a78c-df613ce2c4ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:44.235771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:44.236846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:44.237901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 574/1156] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:44.242902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311ba6d-898c-433d-a754-32511c2e29e6 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:44.341207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311ba6d-898c-433d-a754-32511c2e29e6 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:44.375313 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600e736-4332-46f7-92bd-f180d883bca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:44.375975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600e736-4332-46f7-92bd-f180d883bca5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:44.376254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600e736-4332-46f7-92bd-f180d883bca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:44.376531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600e736-4332-46f7-92bd-f180d883bca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:44.377275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600e736-4332-46f7-92bd-f180d883bca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:44.377584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600e736-4332-46f7-92bd-f180d883bca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:44.378978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600e736-4332-46f7-92bd-f180d883bca5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:44.386804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 583/1157] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:44.393667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45c61-982f-4f25-a78c-df613ce2c4ee None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:44.452383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:44.490610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf45c61-982f-4f25-a78c-df613ce2c4ee None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:44.523507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3ae4f-ff0e-478c-bd11-2aa2a92b68a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:44.524422 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3ae4f-ff0e-478c-bd11-2aa2a92b68a4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:44.524706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3ae4f-ff0e-478c-bd11-2aa2a92b68a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:44.524983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3ae4f-ff0e-478c-bd11-2aa2a92b68a4 None admin] PATH_INFO: `/v3/users/43cd1397229241048a28efdaf3ff9a95` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:44.526164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3ae4f-ff0e-478c-bd11-2aa2a92b68a4 None admin] RBAC: Authorizing `identity:get_user(user_id=43cd1397229241048a28efdaf3ff9a95)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:44.527635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3ae4f-ff0e-478c-bd11-2aa2a92b68a4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:44.529248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 575/1158] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:44 2022] GET /identity/v3/users/43cd1397229241048a28efdaf3ff9a95 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:44.535083 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600e736-4332-46f7-92bd-f180d883bca5 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:44.562906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:44.632097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600e736-4332-46f7-92bd-f180d883bca5 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:44.664415 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530d65f-ec1d-421b-8279-8dae3b126f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:44.665048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530d65f-ec1d-421b-8279-8dae3b126f24 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:44.665331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530d65f-ec1d-421b-8279-8dae3b126f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:44.665609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3530d65f-ec1d-421b-8279-8dae3b126f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:44.730760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530d65f-ec1d-421b-8279-8dae3b126f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:44.732238 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3530d65f-ec1d-421b-8279-8dae3b126f24 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:44.759350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:44.828471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 584/1159] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:44.834285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3ae4f-ff0e-478c-bd11-2aa2a92b68a4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:44.931041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3ae4f-ff0e-478c-bd11-2aa2a92b68a4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:44.958198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:44.964672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c86327-bc3c-4413-aef8-a3cf7f8ab2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:44.965517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c86327-bc3c-4413-aef8-a3cf7f8ab2c5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:44.965796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c86327-bc3c-4413-aef8-a3cf7f8ab2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:44.966067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c86327-bc3c-4413-aef8-a3cf7f8ab2c5 None admin] PATH_INFO: `/v3/projects/ca0bbc4ba1434c58915e64fa344df080` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:44.967251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c86327-bc3c-4413-aef8-a3cf7f8ab2c5 None admin] RBAC: Authorizing `identity:get_project(project_id=ca0bbc4ba1434c58915e64fa344df080)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:44.968713 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c86327-bc3c-4413-aef8-a3cf7f8ab2c5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:44.970376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 576/1160] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:44 2022] GET /identity/v3/projects/ca0bbc4ba1434c58915e64fa344df080 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:44.976372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530d65f-ec1d-421b-8279-8dae3b126f24 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:45.072365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3530d65f-ec1d-421b-8279-8dae3b126f24 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:45.097720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:45.105482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb3d210-8b1d-46fd-b88a-d80f813efae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:45.106117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d210-8b1d-46fd-b88a-d80f813efae5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:45.106395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d210-8b1d-46fd-b88a-d80f813efae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:45.106665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb3d210-8b1d-46fd-b88a-d80f813efae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:45.107511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3d210-8b1d-46fd-b88a-d80f813efae5 None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=ca0bbc4ba1434c58915e64fa344df080, user.id=43cd1397229241048a28efdaf3ff9a95) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:45.107820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3d210-8b1d-46fd-b88a-d80f813efae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:45.110106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb3d210-8b1d-46fd-b88a-d80f813efae5 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:45.115808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 585/1161] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:44 2022] GET /identity/v3/role_assignments?user.id=43cd1397229241048a28efdaf3ff9a95&scope.project.id=ca0bbc4ba1434c58915e64fa344df080&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:47.129332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373dcd-b329-48ea-a170-1dfe7d068add None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:47.129859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373dcd-b329-48ea-a170-1dfe7d068add None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:47.129952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd373dcd-b329-48ea-a170-1dfe7d068add None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:47.131308 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 577/1162] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:47.136533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4173-9a36-4b55-a758-d5d3b39a3d4c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:47.136935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4173-9a36-4b55-a758-d5d3b39a3d4c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:47.137095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4173-9a36-4b55-a758-d5d3b39a3d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:47.154377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-6d0f4173-9a36-4b55-a758-d5d3b39a3d4c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:47.155590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6d0f4173-9a36-4b55-a758-d5d3b39a3d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:47.221947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 586/1163] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:47.243729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd373dcd-b329-48ea-a170-1dfe7d068add None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:47.348525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd373dcd-b329-48ea-a170-1dfe7d068add None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:47.386995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faf69a-ab4a-40a3-9b11-4565fbeb91aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:47.387590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faf69a-ab4a-40a3-9b11-4565fbeb91aa None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:47.387873 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faf69a-ab4a-40a3-9b11-4565fbeb91aa None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:47.388147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10faf69a-ab4a-40a3-9b11-4565fbeb91aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:47.449786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:47.454629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faf69a-ab4a-40a3-9b11-4565fbeb91aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:47.456106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10faf69a-ab4a-40a3-9b11-4565fbeb91aa None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:47.550891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 578/1164] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:47.556967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f4173-9a36-4b55-a758-d5d3b39a3d4c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:47.652358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f4173-9a36-4b55-a758-d5d3b39a3d4c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:47.673626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:47.685049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e674eec8-77a6-4de2-9032-c10eb7ba2855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:47.685837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674eec8-77a6-4de2-9032-c10eb7ba2855 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:47.686121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674eec8-77a6-4de2-9032-c10eb7ba2855 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:47.686395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674eec8-77a6-4de2-9032-c10eb7ba2855 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:47.693453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674eec8-77a6-4de2-9032-c10eb7ba2855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:47.694895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e674eec8-77a6-4de2-9032-c10eb7ba2855 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-e674eec8-77a6-4de2-9032-c10eb7ba2855 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:47.709365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:47.710565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:06:47.711927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 587/1165] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 21 04:06:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:47.716910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faf69a-ab4a-40a3-9b11-4565fbeb91aa None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:47.809506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:47.814036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10faf69a-ab4a-40a3-9b11-4565fbeb91aa None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:47.847085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a2e08-1566-4262-a832-67894475f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:47.847732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2e08-1566-4262-a832-67894475f59e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:47.848017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2e08-1566-4262-a832-67894475f59e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:47.848291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2e08-1566-4262-a832-67894475f59e None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:47.849006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a2e08-1566-4262-a832-67894475f59e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:47.849310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a2e08-1566-4262-a832-67894475f59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:47.850719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a2e08-1566-4262-a832-67894475f59e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:47.857754 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 579/1166] 10.222.0.48 () {56 vars in 1115 bytes} [Thu Jul 21 04:06:47 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:49.864340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f1ee-1adb-4019-950e-abfa9437d3b4 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:49.864869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f1ee-1adb-4019-950e-abfa9437d3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:49.864869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb7f1ee-1adb-4019-950e-abfa9437d3b4 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:49.866269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 588/1167] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:49.871416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7574c40-9123-44a4-ac31-14abf38e56d6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:49.871818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7574c40-9123-44a4-ac31-14abf38e56d6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:49.871972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7574c40-9123-44a4-ac31-14abf38e56d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:49.888636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-b7574c40-9123-44a4-ac31-14abf38e56d6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:49.889814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b7574c40-9123-44a4-ac31-14abf38e56d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:49.955140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 580/1168] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:49.978274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7f1ee-1adb-4019-950e-abfa9437d3b4 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:50.077778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb7f1ee-1adb-4019-950e-abfa9437d3b4 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:50.110805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3d2af4-7449-40fd-98cc-63305ba48a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:50.111484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d2af4-7449-40fd-98cc-63305ba48a53 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:50.111774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d2af4-7449-40fd-98cc-63305ba48a53 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:50.112056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3d2af4-7449-40fd-98cc-63305ba48a53 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:50.112803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d2af4-7449-40fd-98cc-63305ba48a53 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:50.114184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3d2af4-7449-40fd-98cc-63305ba48a53 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:50.129189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 589/1169] 10.222.0.48 () {60 vars in 1138 bytes} [Thu Jul 21 04:06:49 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:52.163153 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf636-6b6b-43d8-97cc-e7fdc55d381f None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:52.163709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf636-6b6b-43d8-97cc-e7fdc55d381f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:52.163709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bcf636-6b6b-43d8-97cc-e7fdc55d381f None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:52.165069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 581/1170] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:52.170264 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589a071-a702-4990-b55b-6664c9dc68a6 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:52.170658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589a071-a702-4990-b55b-6664c9dc68a6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:52.170810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589a071-a702-4990-b55b-6664c9dc68a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:52.188158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d589a071-a702-4990-b55b-6664c9dc68a6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:52.189361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d589a071-a702-4990-b55b-6664c9dc68a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:52.224664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:52.256643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 590/1171] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:52.279990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcf636-6b6b-43d8-97cc-e7fdc55d381f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:52.370919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:52.381746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bcf636-6b6b-43d8-97cc-e7fdc55d381f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:52.414424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4e0b-fc77-4e91-a67e-19470f1a478e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:52.415241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4e0b-fc77-4e91-a67e-19470f1a478e None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:52.415523 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4e0b-fc77-4e91-a67e-19470f1a478e None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:52.415799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4e0b-fc77-4e91-a67e-19470f1a478e None admin] PATH_INFO: `/v3/domains/445ff0a469f443859e6c3882c7d199e1` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:52.426363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf4e0b-fc77-4e91-a67e-19470f1a478e None admin] RBAC: Authorizing `identity:get_domain(domain_id=445ff0a469f443859e6c3882c7d199e1)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:52.427844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf4e0b-fc77-4e91-a67e-19470f1a478e None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:52.429476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 582/1172] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Jul 21 04:06:52 2022] GET /identity/v3/domains/445ff0a469f443859e6c3882c7d199e1 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:52.435442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589a071-a702-4990-b55b-6664c9dc68a6 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:52.531369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589a071-a702-4990-b55b-6664c9dc68a6 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:52.564200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fabe2-8cae-432d-a094-74c748cac244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:52.564853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fabe2-8cae-432d-a094-74c748cac244 None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:52.565138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fabe2-8cae-432d-a094-74c748cac244 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:52.565413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fabe2-8cae-432d-a094-74c748cac244 None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:52.566123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fabe2-8cae-432d-a094-74c748cac244 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:52.567591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fabe2-8cae-432d-a094-74c748cac244 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:52.592170 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 591/1173] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:06:52 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:54.610165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb88bf-a2af-41b5-8c42-3d68ba4cd70c None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:54.610684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb88bf-a2af-41b5-8c42-3d68ba4cd70c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:54.610684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbb88bf-a2af-41b5-8c42-3d68ba4cd70c None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:54.612036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 583/1174] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:54.617078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac8f8-6d4e-4eeb-be97-c9f811b23604 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:54.617511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac8f8-6d4e-4eeb-be97-c9f811b23604 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:54.617639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffac8f8-6d4e-4eeb-be97-c9f811b23604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:54.635218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-dffac8f8-6d4e-4eeb-be97-c9f811b23604 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:54.636393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-dffac8f8-6d4e-4eeb-be97-c9f811b23604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:54.652998 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:54.702086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 592/1175] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:54.726791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb88bf-a2af-41b5-8c42-3d68ba4cd70c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:54.828224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbb88bf-a2af-41b5-8c42-3d68ba4cd70c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:54.862045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1302e-4ff3-4dbb-a14b-8d8bed154e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:54.862819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1302e-4ff3-4dbb-a14b-8d8bed154e0f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:54.863126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1302e-4ff3-4dbb-a14b-8d8bed154e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:54.863398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1302e-4ff3-4dbb-a14b-8d8bed154e0f None admin] PATH_INFO: `/v3/domains/445ff0a469f443859e6c3882c7d199e1` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:54.864560 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1302e-4ff3-4dbb-a14b-8d8bed154e0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=445ff0a469f443859e6c3882c7d199e1)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:54.865981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1302e-4ff3-4dbb-a14b-8d8bed154e0f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:54.867602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 584/1176] 10.222.0.48 () {56 vars in 1183 bytes} [Thu Jul 21 04:06:54 2022] GET /identity/v3/domains/445ff0a469f443859e6c3882c7d199e1 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:06:54.873261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac8f8-6d4e-4eeb-be97-c9f811b23604 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:54.967634 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffac8f8-6d4e-4eeb-be97-c9f811b23604 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:55.000765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb14ee7-29ed-48f9-a205-6134abb3e09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:55.001413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb14ee7-29ed-48f9-a205-6134abb3e09e None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:55.001696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb14ee7-29ed-48f9-a205-6134abb3e09e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:55.001973 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb14ee7-29ed-48f9-a205-6134abb3e09e None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:55.002679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb14ee7-29ed-48f9-a205-6134abb3e09e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:55.004141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb14ee7-29ed-48f9-a205-6134abb3e09e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:55.024747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 593/1177] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:06:54 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:06:57.078288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890512-f4d4-4d3f-82e8-feeb2f4f0459 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:57.078893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890512-f4d4-4d3f-82e8-feeb2f4f0459 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:57.079026 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72890512-f4d4-4d3f-82e8-feeb2f4f0459 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:57.080346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 585/1178] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:06:57.085583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ecfe-8601-41d9-8b39-6a566de38b19 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:57.086016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ecfe-8601-41d9-8b39-6a566de38b19 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:57.086117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5ecfe-8601-41d9-8b39-6a566de38b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:57.103564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-85e5ecfe-8601-41d9-8b39-6a566de38b19 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:06:57.104753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-85e5ecfe-8601-41d9-8b39-6a566de38b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:06:57.108678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:57.172732 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 594/1179] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:06:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:06:57.197100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72890512-f4d4-4d3f-82e8-feeb2f4f0459 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:57.219264 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:57.296650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72890512-f4d4-4d3f-82e8-feeb2f4f0459 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:57.330060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292746a2-176f-480c-a54a-8ea9e731da2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:57.330767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292746a2-176f-480c-a54a-8ea9e731da2b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:57.331073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292746a2-176f-480c-a54a-8ea9e731da2b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:57.331347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292746a2-176f-480c-a54a-8ea9e731da2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:57.341303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292746a2-176f-480c-a54a-8ea9e731da2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-292746a2-176f-480c-a54a-8ea9e731da2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:06:57.348935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:06:57.350132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:06:57.351435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 586/1180] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:06:57.356140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ecfe-8601-41d9-8b39-6a566de38b19 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:57.457569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5ecfe-8601-41d9-8b39-6a566de38b19 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:57.491143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38530-aef9-4c56-9f35-10694eecb092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:57.491804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38530-aef9-4c56-9f35-10694eecb092 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:57.492092 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38530-aef9-4c56-9f35-10694eecb092 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:57.492373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d38530-aef9-4c56-9f35-10694eecb092 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:57.493121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38530-aef9-4c56-9f35-10694eecb092 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:57.493434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38530-aef9-4c56-9f35-10694eecb092 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:57.494824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d38530-aef9-4c56-9f35-10694eecb092 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:57.503326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 595/1181] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:06:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:57.509100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292746a2-176f-480c-a54a-8ea9e731da2b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:57.587755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:57.605957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292746a2-176f-480c-a54a-8ea9e731da2b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:57.638525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627f39f-f5d1-4e29-a395-075fd3018ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:57.639406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f39f-f5d1-4e29-a395-075fd3018ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:57.639683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f39f-f5d1-4e29-a395-075fd3018ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:57.639987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8627f39f-f5d1-4e29-a395-075fd3018ab4 None admin] PATH_INFO: `/v3/users/f46e136d77714200a97d709905e5f8fe` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:57.652902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627f39f-f5d1-4e29-a395-075fd3018ab4 None admin] RBAC: Authorizing `identity:get_user(user_id=f46e136d77714200a97d709905e5f8fe)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:57.654360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8627f39f-f5d1-4e29-a395-075fd3018ab4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:57.656062 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 587/1182] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:06:57 2022] GET /identity/v3/users/f46e136d77714200a97d709905e5f8fe => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:57.661680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38530-aef9-4c56-9f35-10694eecb092 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:57.664598 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:57.760955 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d38530-aef9-4c56-9f35-10694eecb092 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:57.792757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102b0a3-63cd-483b-b0b5-4349517380f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:57.793395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102b0a3-63cd-483b-b0b5-4349517380f6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:57.793681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102b0a3-63cd-483b-b0b5-4349517380f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:57.793958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102b0a3-63cd-483b-b0b5-4349517380f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:57.861335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102b0a3-63cd-483b-b0b5-4349517380f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:57.862979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102b0a3-63cd-483b-b0b5-4349517380f6 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:57.865157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:57.960350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 596/1183] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:06:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:06:57.966479 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627f39f-f5d1-4e29-a395-075fd3018ab4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:58.063033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8627f39f-f5d1-4e29-a395-075fd3018ab4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:58.095919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c306b75-d0d1-4ff0-a153-45138ef7125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:58.096765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c306b75-d0d1-4ff0-a153-45138ef7125d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:58.097051 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c306b75-d0d1-4ff0-a153-45138ef7125d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:58.097327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c306b75-d0d1-4ff0-a153-45138ef7125d None admin] PATH_INFO: `/v3/projects/1f25511283404b27bf0fc157c725a2a0` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:58.098501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c306b75-d0d1-4ff0-a153-45138ef7125d None admin] RBAC: Authorizing `identity:get_project(project_id=1f25511283404b27bf0fc157c725a2a0)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:58.099973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c306b75-d0d1-4ff0-a153-45138ef7125d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:58.101651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 588/1184] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:06:57 2022] GET /identity/v3/projects/1f25511283404b27bf0fc157c725a2a0 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:06:58.107659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102b0a3-63cd-483b-b0b5-4349517380f6 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:06:58.203312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102b0a3-63cd-483b-b0b5-4349517380f6 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:06:58.204849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:06:58.238976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a947b4-7aa8-42e3-b787-bffa7c42b5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:06:58.239649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a947b4-7aa8-42e3-b787-bffa7c42b5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:06:58.239935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a947b4-7aa8-42e3-b787-bffa7c42b5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:06:58.240212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a947b4-7aa8-42e3-b787-bffa7c42b5b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:06:58.241038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a947b4-7aa8-42e3-b787-bffa7c42b5b6 None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=1f25511283404b27bf0fc157c725a2a0, user.id=f46e136d77714200a97d709905e5f8fe) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:06:58.241353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a947b4-7aa8-42e3-b787-bffa7c42b5b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:06:58.242800 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a947b4-7aa8-42e3-b787-bffa7c42b5b6 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:06:58.248137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 597/1185] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:06:58 2022] GET /identity/v3/role_assignments?user.id=f46e136d77714200a97d709905e5f8fe&scope.project.id=1f25511283404b27bf0fc157c725a2a0&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:00.228208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d649-61f4-4caa-b37f-65daf55d1755 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:00.228714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d649-61f4-4caa-b37f-65daf55d1755 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:00.228810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d649-61f4-4caa-b37f-65daf55d1755 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:00.230118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 589/1186] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:00.235937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e50514-bcc9-45ba-b0d7-57958bd26090 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:00.236314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e50514-bcc9-45ba-b0d7-57958bd26090 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:00.236492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e50514-bcc9-45ba-b0d7-57958bd26090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:00.252648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-47e50514-bcc9-45ba-b0d7-57958bd26090 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:00.253840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-47e50514-bcc9-45ba-b0d7-57958bd26090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:00.317214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 598/1187] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:00.340123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582d649-61f4-4caa-b37f-65daf55d1755 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:00.349415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:00.440148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582d649-61f4-4caa-b37f-65daf55d1755 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:00.473032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c373-d1dc-4aa9-a9ae-600498b8ae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:00.473804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c373-d1dc-4aa9-a9ae-600498b8ae41 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:00.474087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c373-d1dc-4aa9-a9ae-600498b8ae41 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:00.474366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0c373-d1dc-4aa9-a9ae-600498b8ae41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:00.484825 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f0c373-d1dc-4aa9-a9ae-600498b8ae41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-01f0c373-d1dc-4aa9-a9ae-600498b8ae41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:07:00.492445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:07:00.493576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:07:00.494580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 590/1188] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:07:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:07:00.499497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e50514-bcc9-45ba-b0d7-57958bd26090 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:00.588236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:00.594815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e50514-bcc9-45ba-b0d7-57958bd26090 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:00.626698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babd65a-ed40-47af-8c25-c77fc912ebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:00.627376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babd65a-ed40-47af-8c25-c77fc912ebf4 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:00.627656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babd65a-ed40-47af-8c25-c77fc912ebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:00.627929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8babd65a-ed40-47af-8c25-c77fc912ebf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:00.628662 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babd65a-ed40-47af-8c25-c77fc912ebf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:00.628970 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babd65a-ed40-47af-8c25-c77fc912ebf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:00.630337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8babd65a-ed40-47af-8c25-c77fc912ebf4 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:00.638063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 599/1189] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:07:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:00.644426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c373-d1dc-4aa9-a9ae-600498b8ae41 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:00.708109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:00.742381 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0c373-d1dc-4aa9-a9ae-600498b8ae41 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:00.774393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7711e-50d6-4d69-9680-a17d17b6e110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:00.775290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7711e-50d6-4d69-9680-a17d17b6e110 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:00.775574 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7711e-50d6-4d69-9680-a17d17b6e110 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:00.775851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7711e-50d6-4d69-9680-a17d17b6e110 None admin] PATH_INFO: `/v3/users/f46e136d77714200a97d709905e5f8fe` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:00.777020 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7711e-50d6-4d69-9680-a17d17b6e110 None admin] RBAC: Authorizing `identity:get_user(user_id=f46e136d77714200a97d709905e5f8fe)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:00.778452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a7711e-50d6-4d69-9680-a17d17b6e110 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:00.780089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 591/1190] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:07:00 2022] GET /identity/v3/users/f46e136d77714200a97d709905e5f8fe => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:00.786107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babd65a-ed40-47af-8c25-c77fc912ebf4 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:00.882471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8babd65a-ed40-47af-8c25-c77fc912ebf4 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:00.914453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b242bf3-6512-46ba-9700-91e342730bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:00.915321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b242bf3-6512-46ba-9700-91e342730bfc None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:00.915602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b242bf3-6512-46ba-9700-91e342730bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:00.915873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b242bf3-6512-46ba-9700-91e342730bfc None admin] PATH_INFO: `/v3/projects/1f25511283404b27bf0fc157c725a2a0` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:00.917029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b242bf3-6512-46ba-9700-91e342730bfc None admin] RBAC: Authorizing `identity:get_project(project_id=1f25511283404b27bf0fc157c725a2a0)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:00.918454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b242bf3-6512-46ba-9700-91e342730bfc None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:00.920149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 600/1191] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:07:00 2022] GET /identity/v3/projects/1f25511283404b27bf0fc157c725a2a0 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:00.926618 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7711e-50d6-4d69-9680-a17d17b6e110 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:01.023572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7711e-50d6-4d69-9680-a17d17b6e110 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:01.056999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff96844-7d9a-4779-9bed-621858558970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:01.057873 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96844-7d9a-4779-9bed-621858558970 None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:01.058160 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96844-7d9a-4779-9bed-621858558970 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:01.058441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff96844-7d9a-4779-9bed-621858558970 None admin] PATH_INFO: `/v3/projects/1f25511283404b27bf0fc157c725a2a0/users/f46e136d77714200a97d709905e5f8fe/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:01.060416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96844-7d9a-4779-9bed-621858558970 None admin] RBAC: Authorizing `identity:create_grant(project_id=1f25511283404b27bf0fc157c725a2a0, user_id=f46e136d77714200a97d709905e5f8fe, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:01.061899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff96844-7d9a-4779-9bed-621858558970 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:01.064087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:01.074746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 592/1192] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:07:00 2022] PUT /identity/v3/projects/1f25511283404b27bf0fc157c725a2a0/users/f46e136d77714200a97d709905e5f8fe/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:07:03.065236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245719e4-2fa5-4b49-a8d8-60cf0a1d7892 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:03.065798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245719e4-2fa5-4b49-a8d8-60cf0a1d7892 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:03.065798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245719e4-2fa5-4b49-a8d8-60cf0a1d7892 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:03.067171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 601/1193] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:03.072273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30171649-4588-440c-b62e-67fcc4085916 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:03.072652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30171649-4588-440c-b62e-67fcc4085916 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:03.072840 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30171649-4588-440c-b62e-67fcc4085916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:03.090698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-30171649-4588-440c-b62e-67fcc4085916 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:03.091917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-30171649-4588-440c-b62e-67fcc4085916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:03.158821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 593/1194] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:07:03.183257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245719e4-2fa5-4b49-a8d8-60cf0a1d7892 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:03.211795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:03.284327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245719e4-2fa5-4b49-a8d8-60cf0a1d7892 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:03.316208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bc576-976a-4660-8c64-f56d1ea76ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:03.316930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bc576-976a-4660-8c64-f56d1ea76ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:03.317214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bc576-976a-4660-8c64-f56d1ea76ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:03.317492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bc576-976a-4660-8c64-f56d1ea76ec5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:03.328495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9bc576-976a-4660-8c64-f56d1ea76ec5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-df9bc576-976a-4660-8c64-f56d1ea76ec5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:07:03.342462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:07:03.343887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:07:03.344984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 602/1195] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:07:03.349645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30171649-4588-440c-b62e-67fcc4085916 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:03.444865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30171649-4588-440c-b62e-67fcc4085916 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:03.474695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:03.486579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9651f-6b5d-442d-98b4-8cea3316b774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:03.487265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9651f-6b5d-442d-98b4-8cea3316b774 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:03.487551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9651f-6b5d-442d-98b4-8cea3316b774 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:03.487825 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9651f-6b5d-442d-98b4-8cea3316b774 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:03.488562 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9651f-6b5d-442d-98b4-8cea3316b774 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:03.488869 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9651f-6b5d-442d-98b4-8cea3316b774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:03.490234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a9651f-6b5d-442d-98b4-8cea3316b774 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:03.498072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 594/1196] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:07:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:03.504460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bc576-976a-4660-8c64-f56d1ea76ec5 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:03.587511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:03.602014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9bc576-976a-4660-8c64-f56d1ea76ec5 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:03.634806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dea85a-e73f-45e1-9b57-e7500a6aced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:03.635679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dea85a-e73f-45e1-9b57-e7500a6aced1 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:03.635962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dea85a-e73f-45e1-9b57-e7500a6aced1 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:03.636235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dea85a-e73f-45e1-9b57-e7500a6aced1 None admin] PATH_INFO: `/v3/users/f46e136d77714200a97d709905e5f8fe` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:03.637400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dea85a-e73f-45e1-9b57-e7500a6aced1 None admin] RBAC: Authorizing `identity:get_user(user_id=f46e136d77714200a97d709905e5f8fe)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:03.638836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dea85a-e73f-45e1-9b57-e7500a6aced1 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:03.640993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 603/1197] 10.222.0.48 () {56 vars in 1177 bytes} [Thu Jul 21 04:07:03 2022] GET /identity/v3/users/f46e136d77714200a97d709905e5f8fe => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:03.646735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9651f-6b5d-442d-98b4-8cea3316b774 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:03.742791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9651f-6b5d-442d-98b4-8cea3316b774 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:03.774853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ee8d3-bb7c-4f33-9b88-8ca323c2499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:03.775507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ee8d3-bb7c-4f33-9b88-8ca323c2499d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:03.775789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ee8d3-bb7c-4f33-9b88-8ca323c2499d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:03.776060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ee8d3-bb7c-4f33-9b88-8ca323c2499d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:03.827207 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:03.841017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ee8d3-bb7c-4f33-9b88-8ca323c2499d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:03.842402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ee8d3-bb7c-4f33-9b88-8ca323c2499d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:03.938408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 595/1198] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:07:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:07:03.944468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dea85a-e73f-45e1-9b57-e7500a6aced1 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:04.042527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dea85a-e73f-45e1-9b57-e7500a6aced1 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:04.075816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3464f6b-61f0-4578-a6ea-a838512147fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:04.076666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464f6b-61f0-4578-a6ea-a838512147fb None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:04.076950 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464f6b-61f0-4578-a6ea-a838512147fb None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:04.077228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464f6b-61f0-4578-a6ea-a838512147fb None admin] PATH_INFO: `/v3/projects/1f25511283404b27bf0fc157c725a2a0` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:04.078428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3464f6b-61f0-4578-a6ea-a838512147fb None admin] RBAC: Authorizing `identity:get_project(project_id=1f25511283404b27bf0fc157c725a2a0)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:04.079906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3464f6b-61f0-4578-a6ea-a838512147fb None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:04.081606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 604/1199] 10.222.0.48 () {56 vars in 1186 bytes} [Thu Jul 21 04:07:03 2022] GET /identity/v3/projects/1f25511283404b27bf0fc157c725a2a0 => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:04.087928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ee8d3-bb7c-4f33-9b88-8ca323c2499d None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:04.180550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:04.195528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ee8d3-bb7c-4f33-9b88-8ca323c2499d None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:04.230186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c7623-c6a8-40d8-9d3a-90bdb07759cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:04.230841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c7623-c6a8-40d8-9d3a-90bdb07759cd None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:04.231153 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c7623-c6a8-40d8-9d3a-90bdb07759cd None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:04.231433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c7623-c6a8-40d8-9d3a-90bdb07759cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:04.232263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c7623-c6a8-40d8-9d3a-90bdb07759cd None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=1f25511283404b27bf0fc157c725a2a0, user.id=f46e136d77714200a97d709905e5f8fe) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:07:04.232578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c7623-c6a8-40d8-9d3a-90bdb07759cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:04.234020 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8c7623-c6a8-40d8-9d3a-90bdb07759cd None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:04.239858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 596/1200] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:07:04 2022] GET /identity/v3/role_assignments?user.id=f46e136d77714200a97d709905e5f8fe&scope.project.id=1f25511283404b27bf0fc157c725a2a0&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:07:14.071796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:14.237215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=25 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:07:59.497187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545055b-004f-425f-95c3-1edf753d20cf None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:59.497762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545055b-004f-425f-95c3-1edf753d20cf None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:59.497762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f545055b-004f-425f-95c3-1edf753d20cf None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:59.499201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 605/1201] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:07:59.505230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7650ae-e82b-43e6-9b38-6681d63f9e49 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:59.505684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7650ae-e82b-43e6-9b38-6681d63f9e49 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:59.505773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7650ae-e82b-43e6-9b38-6681d63f9e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:59.528277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-be7650ae-e82b-43e6-9b38-6681d63f9e49 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:07:59.529820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-be7650ae-e82b-43e6-9b38-6681d63f9e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:07:59.606389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 597/1202] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:07:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 21 04:07:59.632787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545055b-004f-425f-95c3-1edf753d20cf None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:59.774502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f545055b-004f-425f-95c3-1edf753d20cf None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:07:59.814673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861506eb-2f8a-4a98-9060-94b0c1a8bb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:07:59.815680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861506eb-2f8a-4a98-9060-94b0c1a8bb8d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:07:59.816046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861506eb-2f8a-4a98-9060-94b0c1a8bb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:07:59.816263 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861506eb-2f8a-4a98-9060-94b0c1a8bb8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:07:59.829048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861506eb-2f8a-4a98-9060-94b0c1a8bb8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:07:59.830599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861506eb-2f8a-4a98-9060-94b0c1a8bb8d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-861506eb-2f8a-4a98-9060-94b0c1a8bb8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:07:59.853599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:07:59.854682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:07:59.856613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:07:59.856613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:07:59.856613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:07:59.856613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:07:59.856613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 606/1203] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:07:59.861511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7650ae-e82b-43e6-9b38-6681d63f9e49 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:07:59.992085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7650ae-e82b-43e6-9b38-6681d63f9e49 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:00.032838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:00.041476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96a68f-41b3-4e11-8df0-0a0aadbf5998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:00.042285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96a68f-41b3-4e11-8df0-0a0aadbf5998 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:00.042741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96a68f-41b3-4e11-8df0-0a0aadbf5998 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:00.043283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96a68f-41b3-4e11-8df0-0a0aadbf5998 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:00.044187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96a68f-41b3-4e11-8df0-0a0aadbf5998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:00.044559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96a68f-41b3-4e11-8df0-0a0aadbf5998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:00.046265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96a68f-41b3-4e11-8df0-0a0aadbf5998 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:00.069365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 598/1204] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:00.075901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861506eb-2f8a-4a98-9060-94b0c1a8bb8d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:00.143317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:00.230670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861506eb-2f8a-4a98-9060-94b0c1a8bb8d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:00.282547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcae48f7-f2b4-4dde-852e-8cd985e4adae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:00.283398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae48f7-f2b4-4dde-852e-8cd985e4adae None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:00.283625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae48f7-f2b4-4dde-852e-8cd985e4adae None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:00.283931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcae48f7-f2b4-4dde-852e-8cd985e4adae None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:00.284639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae48f7-f2b4-4dde-852e-8cd985e4adae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:00.286085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcae48f7-f2b4-4dde-852e-8cd985e4adae None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:00.314899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 607/1205] 10.222.0.48 () {60 vars in 1132 bytes} [Thu Jul 21 04:08:00 2022] POST /identity/v3/users => generated 251 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:08:02.612340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5b452-8255-4ffd-925d-aabd0484371a None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:02.612863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5b452-8255-4ffd-925d-aabd0484371a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:02.612863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5b452-8255-4ffd-925d-aabd0484371a None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:02.614289 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 599/1206] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:02.619826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b7f62-9288-4855-8eba-9bb47741f33b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:02.621084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b7f62-9288-4855-8eba-9bb47741f33b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:02.621084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259b7f62-9288-4855-8eba-9bb47741f33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:02.641568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-259b7f62-9288-4855-8eba-9bb47741f33b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:02.643032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-259b7f62-9288-4855-8eba-9bb47741f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:02.715048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 608/1207] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:02.739270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5b452-8255-4ffd-925d-aabd0484371a None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:02.866844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5b452-8255-4ffd-925d-aabd0484371a None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:02.909042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf01f4-ced7-461d-93c3-f5ab8a9a483c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:02.909843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf01f4-ced7-461d-93c3-f5ab8a9a483c None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:02.910126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf01f4-ced7-461d-93c3-f5ab8a9a483c None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:02.910403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf01f4-ced7-461d-93c3-f5ab8a9a483c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:02.923150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf01f4-ced7-461d-93c3-f5ab8a9a483c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-58cf01f4-ced7-461d-93c3-f5ab8a9a483c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:02.931495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:02.932546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:02.934352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 600/1208] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:08:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:02.940114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b7f62-9288-4855-8eba-9bb47741f33b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:02.983947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:03.054180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259b7f62-9288-4855-8eba-9bb47741f33b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:03.095242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029a0d-2482-4004-ba53-ece69ece10f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:03.095946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029a0d-2482-4004-ba53-ece69ece10f2 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:03.096250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029a0d-2482-4004-ba53-ece69ece10f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:03.096535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64029a0d-2482-4004-ba53-ece69ece10f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:03.097339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64029a0d-2482-4004-ba53-ece69ece10f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:03.097694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64029a0d-2482-4004-ba53-ece69ece10f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:03.099161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64029a0d-2482-4004-ba53-ece69ece10f2 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:03.108478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 609/1209] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:08:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:03.114036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf01f4-ced7-461d-93c3-f5ab8a9a483c None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:03.171099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:03.227187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf01f4-ced7-461d-93c3-f5ab8a9a483c None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:03.266013 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c37aab-b5fb-434b-a549-c4510611b375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:03.266868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37aab-b5fb-434b-a549-c4510611b375 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:03.267216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37aab-b5fb-434b-a549-c4510611b375 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:03.267519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c37aab-b5fb-434b-a549-c4510611b375 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:03.279800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c37aab-b5fb-434b-a549-c4510611b375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:03.281435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c37aab-b5fb-434b-a549-c4510611b375 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f4c37aab-b5fb-434b-a549-c4510611b375 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:03.300393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:03.301603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:03.302711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:03.302711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:03.302711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:03.302711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:03.306479 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 601/1210] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:03.307484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029a0d-2482-4004-ba53-ece69ece10f2 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:03.419405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:03.426345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64029a0d-2482-4004-ba53-ece69ece10f2 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:03.468416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efd78c-02da-4315-b003-aa16b6530efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:03.469053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efd78c-02da-4315-b003-aa16b6530efe None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:03.469382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efd78c-02da-4315-b003-aa16b6530efe None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:03.469699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6efd78c-02da-4315-b003-aa16b6530efe None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:03.470547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efd78c-02da-4315-b003-aa16b6530efe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:03.470947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efd78c-02da-4315-b003-aa16b6530efe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:03.472581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6efd78c-02da-4315-b003-aa16b6530efe None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:03.490190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 610/1211] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:03.496060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c37aab-b5fb-434b-a549-c4510611b375 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:03.613309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c37aab-b5fb-434b-a549-c4510611b375 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:03.614971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:03.653416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd55ae1-7c7b-4a88-9e96-1b89185074fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:03.654333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55ae1-7c7b-4a88-9e96-1b89185074fc None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:03.654620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55ae1-7c7b-4a88-9e96-1b89185074fc None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:03.654988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55ae1-7c7b-4a88-9e96-1b89185074fc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:03.664406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd55ae1-7c7b-4a88-9e96-1b89185074fc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:03.666090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd55ae1-7c7b-4a88-9e96-1b89185074fc None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-dbd55ae1-7c7b-4a88-9e96-1b89185074fc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:03.684009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:03.685286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:03.686258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 602/1212] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:03.691662 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efd78c-02da-4315-b003-aa16b6530efe None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:03.821397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6efd78c-02da-4315-b003-aa16b6530efe None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:03.860935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4221bed-b6ee-4e3f-b181-9fd592947624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:03.861619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4221bed-b6ee-4e3f-b181-9fd592947624 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:03.861884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4221bed-b6ee-4e3f-b181-9fd592947624 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:03.862261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4221bed-b6ee-4e3f-b181-9fd592947624 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:03.863262 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4221bed-b6ee-4e3f-b181-9fd592947624 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:03.863599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4221bed-b6ee-4e3f-b181-9fd592947624 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:03.865159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4221bed-b6ee-4e3f-b181-9fd592947624 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:03.887735 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 611/1213] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:03.893835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd55ae1-7c7b-4a88-9e96-1b89185074fc None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:04.006796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd55ae1-7c7b-4a88-9e96-1b89185074fc None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:04.046590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109fb0b-c1ba-4e0c-8b12-ee1ce1190546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:04.047284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109fb0b-c1ba-4e0c-8b12-ee1ce1190546 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:04.047558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109fb0b-c1ba-4e0c-8b12-ee1ce1190546 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:04.047836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3109fb0b-c1ba-4e0c-8b12-ee1ce1190546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:04.085124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:04.132011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109fb0b-c1ba-4e0c-8b12-ee1ce1190546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:04.133563 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3109fb0b-c1ba-4e0c-8b12-ee1ce1190546 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:04.248258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 603/1214] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:08:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:08:04.254084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4221bed-b6ee-4e3f-b181-9fd592947624 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:04.287348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:04.406944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4221bed-b6ee-4e3f-b181-9fd592947624 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:04.446469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d3cf3-b7e8-4d58-b276-63f30c047623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:04.447382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d3cf3-b7e8-4d58-b276-63f30c047623 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:04.447674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d3cf3-b7e8-4d58-b276-63f30c047623 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:04.447944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054d3cf3-b7e8-4d58-b276-63f30c047623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:04.459773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d3cf3-b7e8-4d58-b276-63f30c047623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:04.461245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054d3cf3-b7e8-4d58-b276-63f30c047623 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-054d3cf3-b7e8-4d58-b276-63f30c047623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:04.480166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:04.481863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:04.483215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:04.483215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:04.483215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:04.483215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:04.483215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 612/1215] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:08:04.488851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109fb0b-c1ba-4e0c-8b12-ee1ce1190546 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:04.568060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:04.610927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3109fb0b-c1ba-4e0c-8b12-ee1ce1190546 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:04.647496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105c498-73a5-4e97-b77f-3df7a1f18ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:04.648324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105c498-73a5-4e97-b77f-3df7a1f18ec2 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:04.648755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105c498-73a5-4e97-b77f-3df7a1f18ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:04.649131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105c498-73a5-4e97-b77f-3df7a1f18ec2 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:04.649960 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105c498-73a5-4e97-b77f-3df7a1f18ec2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:04.650420 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105c498-73a5-4e97-b77f-3df7a1f18ec2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:04.652218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105c498-73a5-4e97-b77f-3df7a1f18ec2 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:04.671977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 604/1216] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:04.673364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d3cf3-b7e8-4d58-b276-63f30c047623 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:04.747632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:04.783529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054d3cf3-b7e8-4d58-b276-63f30c047623 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:04.821274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fdd71-2949-401f-a547-185a8463ea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:04.822418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fdd71-2949-401f-a547-185a8463ea61 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:04.823208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fdd71-2949-401f-a547-185a8463ea61 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:04.824796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6fdd71-2949-401f-a547-185a8463ea61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:04.832408 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fdd71-2949-401f-a547-185a8463ea61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:04.834182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6fdd71-2949-401f-a547-185a8463ea61 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-9a6fdd71-2949-401f-a547-185a8463ea61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:04.850275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:04.851458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:04.852489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:04.852489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:04.852489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:04.852489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:04.852489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:04.852489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:04.852489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:04.852489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:04.852489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 613/1217] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:04.858552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105c498-73a5-4e97-b77f-3df7a1f18ec2 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:04.976954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105c498-73a5-4e97-b77f-3df7a1f18ec2 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:05.003319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:05.015445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57f7cdf-c8bc-487b-b0e8-f27dc07909d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:05.016106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7cdf-c8bc-487b-b0e8-f27dc07909d5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:05.016436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7cdf-c8bc-487b-b0e8-f27dc07909d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:05.016714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57f7cdf-c8bc-487b-b0e8-f27dc07909d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:05.017606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f7cdf-c8bc-487b-b0e8-f27dc07909d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:05.017922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f7cdf-c8bc-487b-b0e8-f27dc07909d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:05.019583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57f7cdf-c8bc-487b-b0e8-f27dc07909d5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:05.032981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 605/1218] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:05.039025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fdd71-2949-401f-a547-185a8463ea61 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:05.157787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6fdd71-2949-401f-a547-185a8463ea61 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:05.194919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:05.203001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfb5ee-7ed7-4709-a423-38d9a4695425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:05.204927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfb5ee-7ed7-4709-a423-38d9a4695425 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:05.204927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfb5ee-7ed7-4709-a423-38d9a4695425 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:05.204927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfb5ee-7ed7-4709-a423-38d9a4695425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:05.205211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfb5ee-7ed7-4709-a423-38d9a4695425 None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=8572e4c550014fc4b1aea3ddf16f7d2f) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:05.205410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfb5ee-7ed7-4709-a423-38d9a4695425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:05.208829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfb5ee-7ed7-4709-a423-38d9a4695425 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:05.215379 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 614/1219] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:08:05 2022] GET /identity/v3/role_assignments?user.id=8572e4c550014fc4b1aea3ddf16f7d2f&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:07.275111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b1084-e91c-4d36-800a-63c65d5d3ab7 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:07.275629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b1084-e91c-4d36-800a-63c65d5d3ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:07.275744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b1084-e91c-4d36-800a-63c65d5d3ab7 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:07.277237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 606/1220] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:07.283017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b73565-7791-4710-9eb6-2c3266b209af None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:07.283510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b73565-7791-4710-9eb6-2c3266b209af None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:07.283649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b73565-7791-4710-9eb6-2c3266b209af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:07.301115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e2b73565-7791-4710-9eb6-2c3266b209af None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:07.302297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e2b73565-7791-4710-9eb6-2c3266b209af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:07.376676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 615/1221] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:07.399859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b1084-e91c-4d36-800a-63c65d5d3ab7 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:07.521502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b1084-e91c-4d36-800a-63c65d5d3ab7 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:07.558569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdab231-7fae-4ffb-bdf9-1714b2972a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:07.559447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdab231-7fae-4ffb-bdf9-1714b2972a62 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:07.559777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdab231-7fae-4ffb-bdf9-1714b2972a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:07.560124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdab231-7fae-4ffb-bdf9-1714b2972a62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:07.571838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdab231-7fae-4ffb-bdf9-1714b2972a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-5fdab231-7fae-4ffb-bdf9-1714b2972a62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:07.580113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:07.581257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:07.582327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 607/1222] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:08:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:07.587597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b73565-7791-4710-9eb6-2c3266b209af None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:07.698062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b73565-7791-4710-9eb6-2c3266b209af None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:07.722634 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:07.734210 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513290c-0957-4b0c-9d0c-bb9d1f8faaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:07.734872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513290c-0957-4b0c-9d0c-bb9d1f8faaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:07.735183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513290c-0957-4b0c-9d0c-bb9d1f8faaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:07.735455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513290c-0957-4b0c-9d0c-bb9d1f8faaf9 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:07.736190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513290c-0957-4b0c-9d0c-bb9d1f8faaf9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:07.736490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513290c-0957-4b0c-9d0c-bb9d1f8faaf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:07.737869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513290c-0957-4b0c-9d0c-bb9d1f8faaf9 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:07.747509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 616/1223] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:08:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:07.753550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdab231-7fae-4ffb-bdf9-1714b2972a62 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:07.803447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:07.872713 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdab231-7fae-4ffb-bdf9-1714b2972a62 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:07.910745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd6f96-f903-4095-ac37-91c656c814d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:07.911673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6f96-f903-4095-ac37-91c656c814d7 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:07.911957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6f96-f903-4095-ac37-91c656c814d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:07.912230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fd6f96-f903-4095-ac37-91c656c814d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:07.923717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd6f96-f903-4095-ac37-91c656c814d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:07.925186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fd6f96-f903-4095-ac37-91c656c814d7 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-75fd6f96-f903-4095-ac37-91c656c814d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:07.942506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:07.943589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:07.944862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:07.944862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:07.944862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:07.944862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:07.944862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 608/1224] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:07.950738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513290c-0957-4b0c-9d0c-bb9d1f8faaf9 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:08.064452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513290c-0957-4b0c-9d0c-bb9d1f8faaf9 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:08.104789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ee8be-3db9-42cc-8919-6161b9c2255a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:08.105538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee8be-3db9-42cc-8919-6161b9c2255a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:08.105822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee8be-3db9-42cc-8919-6161b9c2255a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:08.106097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee8be-3db9-42cc-8919-6161b9c2255a None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:08.107019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ee8be-3db9-42cc-8919-6161b9c2255a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:08.107405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ee8be-3db9-42cc-8919-6161b9c2255a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:08.108961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ee8be-3db9-42cc-8919-6161b9c2255a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:08.120805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 617/1225] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:08.126739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd6f96-f903-4095-ac37-91c656c814d7 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:08.233334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:08.241004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fd6f96-f903-4095-ac37-91c656c814d7 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:08.277231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a71361-6b8e-4658-8174-979b36a771e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:08.279018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a71361-6b8e-4658-8174-979b36a771e5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:08.279300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a71361-6b8e-4658-8174-979b36a771e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:08.279577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a71361-6b8e-4658-8174-979b36a771e5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:08.288241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a71361-6b8e-4658-8174-979b36a771e5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:08.289768 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a71361-6b8e-4658-8174-979b36a771e5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-72a71361-6b8e-4658-8174-979b36a771e5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:08.305617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:08.306786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:08.308564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 609/1226] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:08.313865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ee8be-3db9-42cc-8919-6161b9c2255a None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:08.364931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:08.422091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ee8be-3db9-42cc-8919-6161b9c2255a None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:08.457687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e040b-de24-4e6a-805f-af18c5f4de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:08.458657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e040b-de24-4e6a-805f-af18c5f4de65 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:08.458943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e040b-de24-4e6a-805f-af18c5f4de65 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:08.459250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e040b-de24-4e6a-805f-af18c5f4de65 None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:08.460091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e040b-de24-4e6a-805f-af18c5f4de65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:08.460396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e040b-de24-4e6a-805f-af18c5f4de65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:08.461836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e040b-de24-4e6a-805f-af18c5f4de65 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:08.480405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 618/1227] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:08.486667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a71361-6b8e-4658-8174-979b36a771e5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:08.602614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a71361-6b8e-4658-8174-979b36a771e5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:08.640107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8961ee-81bc-4342-843c-429e5ff1f9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:08.640858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8961ee-81bc-4342-843c-429e5ff1f9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:08.641184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8961ee-81bc-4342-843c-429e5ff1f9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:08.641512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8961ee-81bc-4342-843c-429e5ff1f9b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:08.653778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8961ee-81bc-4342-843c-429e5ff1f9b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:08.655451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8961ee-81bc-4342-843c-429e5ff1f9b0 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0c8961ee-81bc-4342-843c-429e5ff1f9b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:08.673783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:08.674751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:08.675829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:08.675829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:08.675829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:08.675829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:08.675829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 610/1228] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:08.681102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e040b-de24-4e6a-805f-af18c5f4de65 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:08.793933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e040b-de24-4e6a-805f-af18c5f4de65 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:08.796341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:08.833546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426eeae0-cd87-4fbb-b37b-d8c5d25daeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:08.834271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eeae0-cd87-4fbb-b37b-d8c5d25daeb9 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:08.834651 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eeae0-cd87-4fbb-b37b-d8c5d25daeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:08.834935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426eeae0-cd87-4fbb-b37b-d8c5d25daeb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:08.835908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426eeae0-cd87-4fbb-b37b-d8c5d25daeb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:08.836232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426eeae0-cd87-4fbb-b37b-d8c5d25daeb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:08.838135 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426eeae0-cd87-4fbb-b37b-d8c5d25daeb9 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:08.852513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 619/1229] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:08.859019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8961ee-81bc-4342-843c-429e5ff1f9b0 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:08.869252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:08.980650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8961ee-81bc-4342-843c-429e5ff1f9b0 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:09.017520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef61ddd-2b90-43c4-83a8-eb2cff194047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:09.018395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef61ddd-2b90-43c4-83a8-eb2cff194047 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:09.018686 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef61ddd-2b90-43c4-83a8-eb2cff194047 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:09.019061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef61ddd-2b90-43c4-83a8-eb2cff194047 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:09.026849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef61ddd-2b90-43c4-83a8-eb2cff194047 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:09.029157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef61ddd-2b90-43c4-83a8-eb2cff194047 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-7ef61ddd-2b90-43c4-83a8-eb2cff194047 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:09.044822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:09.046332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:09.047583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:09.047583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:09.047583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:09.047583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:09.047583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:09.047583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:09.047583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:09.047583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:09.051519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 611/1230] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:09.052456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426eeae0-cd87-4fbb-b37b-d8c5d25daeb9 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:09.164545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426eeae0-cd87-4fbb-b37b-d8c5d25daeb9 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:09.208026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44e9c-5a6e-4e44-998b-04dba5a0bfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:09.208844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44e9c-5a6e-4e44-998b-04dba5a0bfea None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:09.209195 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44e9c-5a6e-4e44-998b-04dba5a0bfea None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:09.209512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44e9c-5a6e-4e44-998b-04dba5a0bfea None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:09.210396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a44e9c-5a6e-4e44-998b-04dba5a0bfea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:09.210715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a44e9c-5a6e-4e44-998b-04dba5a0bfea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:09.212237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a44e9c-5a6e-4e44-998b-04dba5a0bfea None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:09.226502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 620/1231] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:09.232647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef61ddd-2b90-43c4-83a8-eb2cff194047 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:09.301550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:09.341709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef61ddd-2b90-43c4-83a8-eb2cff194047 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:09.381476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9084ff0-6ef0-437d-b8b3-455a3cf65ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:09.382600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084ff0-6ef0-437d-b8b3-455a3cf65ff8 None admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:09.382881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084ff0-6ef0-437d-b8b3-455a3cf65ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:09.383175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9084ff0-6ef0-437d-b8b3-455a3cf65ff8 None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/8572e4c550014fc4b1aea3ddf16f7d2f/roles/a1c2e9dff7da4c458034685fb77fed4b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:09.401414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9084ff0-6ef0-437d-b8b3-455a3cf65ff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=8572e4c550014fc4b1aea3ddf16f7d2f, role_id=a1c2e9dff7da4c458034685fb77fed4b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:09.403214 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9084ff0-6ef0-437d-b8b3-455a3cf65ff8 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:09.418042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 612/1232] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:08:09 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/8572e4c550014fc4b1aea3ddf16f7d2f/roles/a1c2e9dff7da4c458034685fb77fed4b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:08:11.547542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7e2bd-8410-4573-809f-3405e2df4ada None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:11.548079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7e2bd-8410-4573-809f-3405e2df4ada None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:11.548079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7e2bd-8410-4573-809f-3405e2df4ada None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:11.549400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 621/1233] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:11.554688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bbe01-df96-485b-922a-1a60dcf15c72 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:11.555103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bbe01-df96-485b-922a-1a60dcf15c72 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:11.555291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bbe01-df96-485b-922a-1a60dcf15c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:11.574017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-dd5bbe01-df96-485b-922a-1a60dcf15c72 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:11.575357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-dd5bbe01-df96-485b-922a-1a60dcf15c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:11.646106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 613/1234] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:11.671235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7e2bd-8410-4573-809f-3405e2df4ada None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:11.697568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:11.783275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7e2bd-8410-4573-809f-3405e2df4ada None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:11.820634 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0e05b-9c3b-420f-97be-982857213b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:11.821337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0e05b-9c3b-420f-97be-982857213b73 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:11.821615 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0e05b-9c3b-420f-97be-982857213b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:11.821887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a0e05b-9c3b-420f-97be-982857213b73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:11.833393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a0e05b-9c3b-420f-97be-982857213b73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-30a0e05b-9c3b-420f-97be-982857213b73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:11.841809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:11.842933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 21 04:08:11.844363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:11.845184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 622/1235] 10.222.0.48 () {56 vars in 1102 bytes} [Thu Jul 21 04:08:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:11.851759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bbe01-df96-485b-922a-1a60dcf15c72 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:11.908338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:11.972188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bbe01-df96-485b-922a-1a60dcf15c72 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:12.010155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddf653-962f-4629-ada1-f3a0b7e0ada5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:12.010916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddf653-962f-4629-ada1-f3a0b7e0ada5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:12.011291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddf653-962f-4629-ada1-f3a0b7e0ada5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:12.011637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddf653-962f-4629-ada1-f3a0b7e0ada5 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:12.012554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddf653-962f-4629-ada1-f3a0b7e0ada5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:12.012963 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddf653-962f-4629-ada1-f3a0b7e0ada5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:12.014502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddf653-962f-4629-ada1-f3a0b7e0ada5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:12.024241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 614/1236] 10.222.0.48 () {56 vars in 1103 bytes} [Thu Jul 21 04:08:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:12.030579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0e05b-9c3b-420f-97be-982857213b73 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:12.129660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:12.148958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a0e05b-9c3b-420f-97be-982857213b73 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:12.190943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17840e64-c119-4950-8841-651759830b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:12.191981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840e64-c119-4950-8841-651759830b31 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:12.192359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840e64-c119-4950-8841-651759830b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:12.192649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840e64-c119-4950-8841-651759830b31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:12.204545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17840e64-c119-4950-8841-651759830b31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:12.206008 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17840e64-c119-4950-8841-651759830b31 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-17840e64-c119-4950-8841-651759830b31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:12.224181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:12.225346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:12.226722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:12.226722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:12.226722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:12.226722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:12.226722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 623/1237] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:12.231669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddf653-962f-4629-ada1-f3a0b7e0ada5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:12.343749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddf653-962f-4629-ada1-f3a0b7e0ada5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:12.353222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:12.381273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db7226-9662-4d5d-84fb-22d5d3ce312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:12.382062 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db7226-9662-4d5d-84fb-22d5d3ce312a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:12.382425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db7226-9662-4d5d-84fb-22d5d3ce312a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:12.382834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22db7226-9662-4d5d-84fb-22d5d3ce312a None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:12.383597 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db7226-9662-4d5d-84fb-22d5d3ce312a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:12.383906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db7226-9662-4d5d-84fb-22d5d3ce312a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:12.385794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22db7226-9662-4d5d-84fb-22d5d3ce312a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:12.398856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 615/1238] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:12.406035 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17840e64-c119-4950-8841-651759830b31 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:12.518876 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17840e64-c119-4950-8841-651759830b31 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:12.555587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5204b3e-d214-4b92-aae5-ebb52d17d939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:12.556396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5204b3e-d214-4b92-aae5-ebb52d17d939 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:12.556679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5204b3e-d214-4b92-aae5-ebb52d17d939 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:12.557620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5204b3e-d214-4b92-aae5-ebb52d17d939 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:12.560456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:12.566737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5204b3e-d214-4b92-aae5-ebb52d17d939 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:12.568492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5204b3e-d214-4b92-aae5-ebb52d17d939 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f5204b3e-d214-4b92-aae5-ebb52d17d939 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:12.583488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:12.584699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:12.585918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 624/1239] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:08:12.593445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db7226-9662-4d5d-84fb-22d5d3ce312a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:12.705572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22db7226-9662-4d5d-84fb-22d5d3ce312a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:12.740315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063c2c-022f-4fc2-a123-d1c5c2edb343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:12.740992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063c2c-022f-4fc2-a123-d1c5c2edb343 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:12.741339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063c2c-022f-4fc2-a123-d1c5c2edb343 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:12.741583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa063c2c-022f-4fc2-a123-d1c5c2edb343 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:12.742400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063c2c-022f-4fc2-a123-d1c5c2edb343 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:12.742711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063c2c-022f-4fc2-a123-d1c5c2edb343 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:12.744243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa063c2c-022f-4fc2-a123-d1c5c2edb343 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:12.763439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 616/1240] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:12.769041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5204b3e-d214-4b92-aae5-ebb52d17d939 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:12.876502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5204b3e-d214-4b92-aae5-ebb52d17d939 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:12.917267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bb20b-978b-469b-b196-26718d99777f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:12.918116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bb20b-978b-469b-b196-26718d99777f None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:12.918465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bb20b-978b-469b-b196-26718d99777f None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:12.918796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52bb20b-978b-469b-b196-26718d99777f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:12.989504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:12.997946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bb20b-978b-469b-b196-26718d99777f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:12.999486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52bb20b-978b-469b-b196-26718d99777f None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:13.111326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 625/1241] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:08:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:08:13.117454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063c2c-022f-4fc2-a123-d1c5c2edb343 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:13.147965 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:13.233359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa063c2c-022f-4fc2-a123-d1c5c2edb343 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:13.275082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74efa67-76de-49fa-96d6-a6144e9463a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:13.276845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74efa67-76de-49fa-96d6-a6144e9463a3 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:13.277170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74efa67-76de-49fa-96d6-a6144e9463a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:13.277547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74efa67-76de-49fa-96d6-a6144e9463a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:13.290672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74efa67-76de-49fa-96d6-a6144e9463a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:13.292585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74efa67-76de-49fa-96d6-a6144e9463a3 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-f74efa67-76de-49fa-96d6-a6144e9463a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:13.314588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:13.315831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:13.321523 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:13.321523 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:13.321523 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:13.321523 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:13.321523 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 617/1242] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:08:13.321870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bb20b-978b-469b-b196-26718d99777f None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:13.436798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:13.443987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52bb20b-978b-469b-b196-26718d99777f None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:13.483698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc288762-b422-432a-a2f8-1419e74f25ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:13.484312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc288762-b422-432a-a2f8-1419e74f25ea None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:13.484594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc288762-b422-432a-a2f8-1419e74f25ea None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:13.484871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc288762-b422-432a-a2f8-1419e74f25ea None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:13.485643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc288762-b422-432a-a2f8-1419e74f25ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:13.485899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc288762-b422-432a-a2f8-1419e74f25ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:13.487319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc288762-b422-432a-a2f8-1419e74f25ea None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:13.499386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 626/1243] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:13.505164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74efa67-76de-49fa-96d6-a6144e9463a3 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:13.596437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:13.624083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74efa67-76de-49fa-96d6-a6144e9463a3 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:13.667002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3116-ea39-4383-acd2-36d9c33fa1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:13.668340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3116-ea39-4383-acd2-36d9c33fa1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:13.668795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3116-ea39-4383-acd2-36d9c33fa1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:13.669310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3116-ea39-4383-acd2-36d9c33fa1e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:13.678374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c3116-ea39-4383-acd2-36d9c33fa1e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:13.680156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5c3116-ea39-4383-acd2-36d9c33fa1e4 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-5c5c3116-ea39-4383-acd2-36d9c33fa1e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:13.695047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:13.696283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:13.697867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:13.697867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:13.697867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:13.697867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:13.697867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:13.697867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:13.697867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:13.697867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:13.701785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 618/1244] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:13.703011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc288762-b422-432a-a2f8-1419e74f25ea None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:13.814065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc288762-b422-432a-a2f8-1419e74f25ea None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:13.852172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95900621-529a-4a3a-8149-3eb433d6515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:13.852764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95900621-529a-4a3a-8149-3eb433d6515a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:13.853062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95900621-529a-4a3a-8149-3eb433d6515a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:13.853322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95900621-529a-4a3a-8149-3eb433d6515a None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:13.854784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95900621-529a-4a3a-8149-3eb433d6515a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:13.855213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95900621-529a-4a3a-8149-3eb433d6515a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:13.856658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95900621-529a-4a3a-8149-3eb433d6515a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:13.871412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 627/1245] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:13.877703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3116-ea39-4383-acd2-36d9c33fa1e4 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:13.992835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3116-ea39-4383-acd2-36d9c33fa1e4 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:14.032470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed54577-7490-4645-9f37-693d741ec210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:14.033124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed54577-7490-4645-9f37-693d741ec210 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:14.033407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed54577-7490-4645-9f37-693d741ec210 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:14.033675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed54577-7490-4645-9f37-693d741ec210 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:14.034497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed54577-7490-4645-9f37-693d741ec210 None admin] RBAC: Adding query filter params (role.id=a1c2e9dff7da4c458034685fb77fed4b, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=8572e4c550014fc4b1aea3ddf16f7d2f) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:14.034809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed54577-7490-4645-9f37-693d741ec210 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:14.036530 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed54577-7490-4645-9f37-693d741ec210 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:14.043741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 619/1246] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:08:13 2022] GET /identity/v3/role_assignments?user.id=8572e4c550014fc4b1aea3ddf16f7d2f&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=a1c2e9dff7da4c458034685fb77fed4b => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:16.221167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421074-12f7-4f12-b07c-d3687fe93929 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:16.221807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421074-12f7-4f12-b07c-d3687fe93929 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:16.221959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae421074-12f7-4f12-b07c-d3687fe93929 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:16.223775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 628/1247] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:16.229339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8473f36-225d-4a00-8d25-f315a0196154 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:16.229770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8473f36-225d-4a00-8d25-f315a0196154 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:16.229992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8473f36-225d-4a00-8d25-f315a0196154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:16.236182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:16.250365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c8473f36-225d-4a00-8d25-f315a0196154 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:16.251829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c8473f36-225d-4a00-8d25-f315a0196154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:16.332731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 620/1248] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:16.360388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421074-12f7-4f12-b07c-d3687fe93929 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:16.381038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:16.477804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae421074-12f7-4f12-b07c-d3687fe93929 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:16.516025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb4fcf-e335-4053-be03-ff7e1e8e1e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:16.516922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb4fcf-e335-4053-be03-ff7e1e8e1e3e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:16.517222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb4fcf-e335-4053-be03-ff7e1e8e1e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:16.517515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb4fcf-e335-4053-be03-ff7e1e8e1e3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:16.530598 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb4fcf-e335-4053-be03-ff7e1e8e1e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-7bcb4fcf-e335-4053-be03-ff7e1e8e1e3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:16.540031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:16.541780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:16.542736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:16.547821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 629/1249] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:08:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:16.548846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8473f36-225d-4a00-8d25-f315a0196154 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:16.662906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8473f36-225d-4a00-8d25-f315a0196154 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:16.697535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:16.704006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378b6d7-d82a-4804-a36e-7e2a46b3f60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:16.704697 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378b6d7-d82a-4804-a36e-7e2a46b3f60b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:16.704977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378b6d7-d82a-4804-a36e-7e2a46b3f60b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:16.705250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a378b6d7-d82a-4804-a36e-7e2a46b3f60b None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:16.705995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378b6d7-d82a-4804-a36e-7e2a46b3f60b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:16.706303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378b6d7-d82a-4804-a36e-7e2a46b3f60b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:16.708099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a378b6d7-d82a-4804-a36e-7e2a46b3f60b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:16.718899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 621/1250] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:08:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:16.725088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb4fcf-e335-4053-be03-ff7e1e8e1e3e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:16.817105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:16.845452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb4fcf-e335-4053-be03-ff7e1e8e1e3e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:16.892744 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd4784-5920-4873-915a-bd76f28b7a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:16.893605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd4784-5920-4873-915a-bd76f28b7a99 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:16.893972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd4784-5920-4873-915a-bd76f28b7a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:16.894245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd4784-5920-4873-915a-bd76f28b7a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:16.908316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd4784-5920-4873-915a-bd76f28b7a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:16.909930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd4784-5920-4873-915a-bd76f28b7a99 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-bfcd4784-5920-4873-915a-bd76f28b7a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:16.930353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:16.931924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:16.938666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:16.938666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:16.938666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:16.938666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:16.938666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 630/1251] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:16.939748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378b6d7-d82a-4804-a36e-7e2a46b3f60b None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:17.063497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a378b6d7-d82a-4804-a36e-7e2a46b3f60b None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:17.102619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e849-68c9-4b79-a60d-08f3c2e09307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:17.103205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e849-68c9-4b79-a60d-08f3c2e09307 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:17.103513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e849-68c9-4b79-a60d-08f3c2e09307 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:17.103790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059e849-68c9-4b79-a60d-08f3c2e09307 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:17.104520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059e849-68c9-4b79-a60d-08f3c2e09307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:17.104834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059e849-68c9-4b79-a60d-08f3c2e09307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:17.106216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059e849-68c9-4b79-a60d-08f3c2e09307 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:17.118633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 622/1252] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:17.124969 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd4784-5920-4873-915a-bd76f28b7a99 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:17.238593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd4784-5920-4873-915a-bd76f28b7a99 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:17.268622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:17.278047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bc009-4354-4704-81dc-248037ef6a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:17.278934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bc009-4354-4704-81dc-248037ef6a93 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:17.279246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bc009-4354-4704-81dc-248037ef6a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:17.279532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98bc009-4354-4704-81dc-248037ef6a93 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:17.287813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bc009-4354-4704-81dc-248037ef6a93 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:17.289347 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98bc009-4354-4704-81dc-248037ef6a93 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-f98bc009-4354-4704-81dc-248037ef6a93 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:17.306585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:17.309442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:17.310806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 631/1253] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:17.314432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e849-68c9-4b79-a60d-08f3c2e09307 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:17.396541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:17.456247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059e849-68c9-4b79-a60d-08f3c2e09307 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:17.496676 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374dfa3-3311-4c2f-9384-f0d81057058a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:17.497341 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374dfa3-3311-4c2f-9384-f0d81057058a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:17.497620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374dfa3-3311-4c2f-9384-f0d81057058a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:17.497892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374dfa3-3311-4c2f-9384-f0d81057058a None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:17.498728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374dfa3-3311-4c2f-9384-f0d81057058a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:17.499067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374dfa3-3311-4c2f-9384-f0d81057058a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:17.500494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374dfa3-3311-4c2f-9384-f0d81057058a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:17.523022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 623/1254] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:17.526167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bc009-4354-4704-81dc-248037ef6a93 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:17.644460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98bc009-4354-4704-81dc-248037ef6a93 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:17.683834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0728ee-6e76-49d4-8959-d142f3f5c054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:17.684484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0728ee-6e76-49d4-8959-d142f3f5c054 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:17.684762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0728ee-6e76-49d4-8959-d142f3f5c054 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:17.685036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0728ee-6e76-49d4-8959-d142f3f5c054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:17.745459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:17.759107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0728ee-6e76-49d4-8959-d142f3f5c054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:17.761512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0728ee-6e76-49d4-8959-d142f3f5c054 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:17.875907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 632/1255] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:08:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:08:17.882079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374dfa3-3311-4c2f-9384-f0d81057058a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:18.005325 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374dfa3-3311-4c2f-9384-f0d81057058a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:18.020249 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:18.044274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaca3ef-b9cf-4bd0-ac83-cce25007e242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:18.045126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca3ef-b9cf-4bd0-ac83-cce25007e242 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:18.045412 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca3ef-b9cf-4bd0-ac83-cce25007e242 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:18.045684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca3ef-b9cf-4bd0-ac83-cce25007e242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:18.058049 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaca3ef-b9cf-4bd0-ac83-cce25007e242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:18.059578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaca3ef-b9cf-4bd0-ac83-cce25007e242 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-fcaca3ef-b9cf-4bd0-ac83-cce25007e242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:18.080637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:18.081575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:18.082742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:18.082742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:18.082742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:18.082742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:18.082742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 624/1256] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:18.087965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0728ee-6e76-49d4-8959-d142f3f5c054 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:18.192136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:18.206867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0728ee-6e76-49d4-8959-d142f3f5c054 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:18.242428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13fd25-8e78-43b0-8d81-40197dcdcb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:18.243107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13fd25-8e78-43b0-8d81-40197dcdcb96 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:18.243378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13fd25-8e78-43b0-8d81-40197dcdcb96 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:18.243651 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13fd25-8e78-43b0-8d81-40197dcdcb96 None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:18.244414 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13fd25-8e78-43b0-8d81-40197dcdcb96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:18.244712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13fd25-8e78-43b0-8d81-40197dcdcb96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:18.246075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13fd25-8e78-43b0-8d81-40197dcdcb96 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:18.264190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 633/1257] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:18.265490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaca3ef-b9cf-4bd0-ac83-cce25007e242 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:18.378674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaca3ef-b9cf-4bd0-ac83-cce25007e242 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:18.416976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce820415-f41c-4cdf-a5c0-bf9ab3285359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:18.417763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce820415-f41c-4cdf-a5c0-bf9ab3285359 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:18.419371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce820415-f41c-4cdf-a5c0-bf9ab3285359 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:18.419664 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce820415-f41c-4cdf-a5c0-bf9ab3285359 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:18.428294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce820415-f41c-4cdf-a5c0-bf9ab3285359 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:18.429760 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce820415-f41c-4cdf-a5c0-bf9ab3285359 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-ce820415-f41c-4cdf-a5c0-bf9ab3285359 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:18.443798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:18.445010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:18.446015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:18.446015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:18.446015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:18.446015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:18.446015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:18.446015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:18.446015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:18.446015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:18.446015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 625/1258] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:08:18.451692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13fd25-8e78-43b0-8d81-40197dcdcb96 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:18.561370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13fd25-8e78-43b0-8d81-40197dcdcb96 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:18.597336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6e8f32-dddd-4788-8f1d-065a67f95f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:18.598117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e8f32-dddd-4788-8f1d-065a67f95f3a None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:18.598513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e8f32-dddd-4788-8f1d-065a67f95f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:18.598854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6e8f32-dddd-4788-8f1d-065a67f95f3a None admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:18.599707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e8f32-dddd-4788-8f1d-065a67f95f3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:18.600077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e8f32-dddd-4788-8f1d-065a67f95f3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:18.601914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6e8f32-dddd-4788-8f1d-065a67f95f3a None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:18.617071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 634/1259] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:18.623410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce820415-f41c-4cdf-a5c0-bf9ab3285359 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:18.653531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:18.732573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce820415-f41c-4cdf-a5c0-bf9ab3285359 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:18.768148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d89ef-4941-4cd0-87ab-bfb5ff01e94d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:18.768778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d89ef-4941-4cd0-87ab-bfb5ff01e94d None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:18.769064 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d89ef-4941-4cd0-87ab-bfb5ff01e94d None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:18.769338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d89ef-4941-4cd0-87ab-bfb5ff01e94d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:18.770265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d89ef-4941-4cd0-87ab-bfb5ff01e94d None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=8572e4c550014fc4b1aea3ddf16f7d2f) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:18.770535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d89ef-4941-4cd0-87ab-bfb5ff01e94d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:18.772046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d89ef-4941-4cd0-87ab-bfb5ff01e94d None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:18.778423 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 626/1260] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:08:18 2022] GET /identity/v3/role_assignments?user.id=8572e4c550014fc4b1aea3ddf16f7d2f&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:20.797901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a39b4f-84c8-47fb-b4df-85e35cf1de9d None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:20.798455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a39b4f-84c8-47fb-b4df-85e35cf1de9d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:20.798455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a39b4f-84c8-47fb-b4df-85e35cf1de9d None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:20.799868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 635/1261] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:20.804846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34ee4e-e553-460f-b93c-83fa7ba27972 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:20.805214 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34ee4e-e553-460f-b93c-83fa7ba27972 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:20.805404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34ee4e-e553-460f-b93c-83fa7ba27972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:20.823226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-6c34ee4e-e553-460f-b93c-83fa7ba27972 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:20.824386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6c34ee4e-e553-460f-b93c-83fa7ba27972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:20.897056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 627/1262] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:20.925488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a39b4f-84c8-47fb-b4df-85e35cf1de9d None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:20.936361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:21.023564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a39b4f-84c8-47fb-b4df-85e35cf1de9d None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:21.057508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd00d96-4c56-4bbd-9f0e-72b8c4cad79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:21.058229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd00d96-4c56-4bbd-9f0e-72b8c4cad79c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:21.058511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd00d96-4c56-4bbd-9f0e-72b8c4cad79c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:21.058784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd00d96-4c56-4bbd-9f0e-72b8c4cad79c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:21.068618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd00d96-4c56-4bbd-9f0e-72b8c4cad79c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-2cd00d96-4c56-4bbd-9f0e-72b8c4cad79c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:21.076561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:21.077661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:21.078696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 636/1263] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:21.084011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34ee4e-e553-460f-b93c-83fa7ba27972 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:21.102365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:21.180494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34ee4e-e553-460f-b93c-83fa7ba27972 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:21.214911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ef1f-7215-42ef-92cd-cc947c6c0657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:21.215611 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ef1f-7215-42ef-92cd-cc947c6c0657 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:21.215896 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ef1f-7215-42ef-92cd-cc947c6c0657 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:21.216175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780ef1f-7215-42ef-92cd-cc947c6c0657 None admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:21.216919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780ef1f-7215-42ef-92cd-cc947c6c0657 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:21.217226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780ef1f-7215-42ef-92cd-cc947c6c0657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:21.218601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b780ef1f-7215-42ef-92cd-cc947c6c0657 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:21.226532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 628/1264] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:21.232184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd00d96-4c56-4bbd-9f0e-72b8c4cad79c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:21.296132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:21.329114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd00d96-4c56-4bbd-9f0e-72b8c4cad79c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:21.362002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f42dc-289a-4c86-8574-ff13c925a1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:21.362810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f42dc-289a-4c86-8574-ff13c925a1a1 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:21.363120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f42dc-289a-4c86-8574-ff13c925a1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:21.363398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f42dc-289a-4c86-8574-ff13c925a1a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:21.373882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f42dc-289a-4c86-8574-ff13c925a1a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:21.375361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362f42dc-289a-4c86-8574-ff13c925a1a1 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-362f42dc-289a-4c86-8574-ff13c925a1a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:21.393644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:21.394848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:21.395799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:21.395799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:21.395799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:21.395799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:21.395799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 637/1265] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:21.401383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ef1f-7215-42ef-92cd-cc947c6c0657 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:21.480753 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:21.499327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780ef1f-7215-42ef-92cd-cc947c6c0657 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:21.532568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378deb8-f82d-4667-b55e-79d923f499bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:21.533221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378deb8-f82d-4667-b55e-79d923f499bd None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:21.533512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378deb8-f82d-4667-b55e-79d923f499bd None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:21.533794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b378deb8-f82d-4667-b55e-79d923f499bd None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:21.534517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378deb8-f82d-4667-b55e-79d923f499bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:21.534828 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378deb8-f82d-4667-b55e-79d923f499bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:21.536240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b378deb8-f82d-4667-b55e-79d923f499bd None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:21.548304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 629/1266] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:21.553961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f42dc-289a-4c86-8574-ff13c925a1a1 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:21.651280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362f42dc-289a-4c86-8574-ff13c925a1a1 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:21.669890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:21.684654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099da694-5e57-4aa5-992d-60cfe8d9a44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:21.685441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099da694-5e57-4aa5-992d-60cfe8d9a44e None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:21.685719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099da694-5e57-4aa5-992d-60cfe8d9a44e None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:21.685988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099da694-5e57-4aa5-992d-60cfe8d9a44e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:21.694207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099da694-5e57-4aa5-992d-60cfe8d9a44e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:21.695695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099da694-5e57-4aa5-992d-60cfe8d9a44e None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-099da694-5e57-4aa5-992d-60cfe8d9a44e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:21.710593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:21.711726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:21.712873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 638/1267] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:21.717734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378deb8-f82d-4667-b55e-79d923f499bd None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:21.814289 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b378deb8-f82d-4667-b55e-79d923f499bd None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:21.847608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7b285-05e4-433b-9c10-a51d1e064a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:21.848261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7b285-05e4-433b-9c10-a51d1e064a34 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:21.848543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7b285-05e4-433b-9c10-a51d1e064a34 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:21.848819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7b285-05e4-433b-9c10-a51d1e064a34 None admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:21.849644 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7b285-05e4-433b-9c10-a51d1e064a34 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:21.849951 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7b285-05e4-433b-9c10-a51d1e064a34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:21.851409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7b285-05e4-433b-9c10-a51d1e064a34 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:21.859785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:21.868984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 630/1268] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:21.876567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099da694-5e57-4aa5-992d-60cfe8d9a44e None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:21.981329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099da694-5e57-4aa5-992d-60cfe8d9a44e None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:22.013406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba36be3-6fb6-4e59-8b0d-6881362b4892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:22.014177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba36be3-6fb6-4e59-8b0d-6881362b4892 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:22.014454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba36be3-6fb6-4e59-8b0d-6881362b4892 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:22.014726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba36be3-6fb6-4e59-8b0d-6881362b4892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:22.024799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba36be3-6fb6-4e59-8b0d-6881362b4892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:22.026282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba36be3-6fb6-4e59-8b0d-6881362b4892 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-4ba36be3-6fb6-4e59-8b0d-6881362b4892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:22.043213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:22.044288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:22.045578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:22.045578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:22.045578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:22.045578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:22.045578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 639/1269] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:08:22.050155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7b285-05e4-433b-9c10-a51d1e064a34 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:22.145169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7b285-05e4-433b-9c10-a51d1e064a34 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:22.177546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322457f3-6338-4c6b-8a9f-8db25611ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:22.178188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322457f3-6338-4c6b-8a9f-8db25611ccfa None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:22.178467 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322457f3-6338-4c6b-8a9f-8db25611ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:22.178739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322457f3-6338-4c6b-8a9f-8db25611ccfa None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:22.179500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322457f3-6338-4c6b-8a9f-8db25611ccfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:22.179805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322457f3-6338-4c6b-8a9f-8db25611ccfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:22.181176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322457f3-6338-4c6b-8a9f-8db25611ccfa None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:22.193683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 631/1270] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:22.199746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba36be3-6fb6-4e59-8b0d-6881362b4892 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:22.231252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:22.298554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba36be3-6fb6-4e59-8b0d-6881362b4892 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:22.331481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f82b-52a6-4626-bd1e-6eb821b6969c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:22.332515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f82b-52a6-4626-bd1e-6eb821b6969c None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:22.332798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f82b-52a6-4626-bd1e-6eb821b6969c None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:22.333076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e9f82b-52a6-4626-bd1e-6eb821b6969c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:22.339623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9f82b-52a6-4626-bd1e-6eb821b6969c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:22.341081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e9f82b-52a6-4626-bd1e-6eb821b6969c None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-34e9f82b-52a6-4626-bd1e-6eb821b6969c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:22.355169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:22.356217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:22.357370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:22.357370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:22.357370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:22.357370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:22.357370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:22.357370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:22.357370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:22.357370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:22.357370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 640/1271] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:22.362288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322457f3-6338-4c6b-8a9f-8db25611ccfa None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:22.420262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:22.463083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322457f3-6338-4c6b-8a9f-8db25611ccfa None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:22.495614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ea529b-e6e4-45c9-84c2-7955b7ddc61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:22.496256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea529b-e6e4-45c9-84c2-7955b7ddc61b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:22.496541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea529b-e6e4-45c9-84c2-7955b7ddc61b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:22.496815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ea529b-e6e4-45c9-84c2-7955b7ddc61b None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:22.497596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea529b-e6e4-45c9-84c2-7955b7ddc61b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:22.497906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea529b-e6e4-45c9-84c2-7955b7ddc61b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:22.499373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ea529b-e6e4-45c9-84c2-7955b7ddc61b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:22.512645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 632/1272] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:22.518701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f82b-52a6-4626-bd1e-6eb821b6969c None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:22.606968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:22.615512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e9f82b-52a6-4626-bd1e-6eb821b6969c None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:22.648843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d92361-7fea-444d-bdd1-cf6b56335abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:22.649714 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d92361-7fea-444d-bdd1-cf6b56335abd None admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:22.650000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d92361-7fea-444d-bdd1-cf6b56335abd None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:22.650279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d92361-7fea-444d-bdd1-cf6b56335abd None admin] PATH_INFO: `/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/8572e4c550014fc4b1aea3ddf16f7d2f/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:22.652373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d92361-7fea-444d-bdd1-cf6b56335abd None admin] RBAC: Authorizing `identity:create_grant(project_id=9d0157137c144c9c87c3a2d26a502701, user_id=8572e4c550014fc4b1aea3ddf16f7d2f, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:22.653812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d92361-7fea-444d-bdd1-cf6b56335abd None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:22.666802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 641/1273] 10.222.0.48 () {58 vars in 1439 bytes} [Thu Jul 21 04:08:22 2022] PUT /identity/v3/projects/9d0157137c144c9c87c3a2d26a502701/users/8572e4c550014fc4b1aea3ddf16f7d2f/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:08:24.690823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a52a-455a-4d48-8906-9beeed2f8b93 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:24.691363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a52a-455a-4d48-8906-9beeed2f8b93 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:24.691457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25a52a-455a-4d48-8906-9beeed2f8b93 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:24.692799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 633/1274] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:24.698479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c24288-89c2-4a54-a8e8-43bb6724d1d2 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:24.698844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c24288-89c2-4a54-a8e8-43bb6724d1d2 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:24.699075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c24288-89c2-4a54-a8e8-43bb6724d1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:24.716276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-52c24288-89c2-4a54-a8e8-43bb6724d1d2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:24.717481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-52c24288-89c2-4a54-a8e8-43bb6724d1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:24.785871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 642/1275] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:24.810360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25a52a-455a-4d48-8906-9beeed2f8b93 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:24.908452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25a52a-455a-4d48-8906-9beeed2f8b93 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:24.925241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:24.942151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcf78a-e431-4ec4-92ae-2f4ed9214542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:24.942858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcf78a-e431-4ec4-92ae-2f4ed9214542 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:24.943164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcf78a-e431-4ec4-92ae-2f4ed9214542 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:24.943438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbcf78a-e431-4ec4-92ae-2f4ed9214542 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:24.953154 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbcf78a-e431-4ec4-92ae-2f4ed9214542 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-1dbcf78a-e431-4ec4-92ae-2f4ed9214542 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 21 04:08:24.960958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:24.962084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:24.963384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 634/1276] 10.222.0.48 () {56 vars in 1096 bytes} [Thu Jul 21 04:08:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:24.968014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c24288-89c2-4a54-a8e8-43bb6724d1d2 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.045397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:25.063848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c24288-89c2-4a54-a8e8-43bb6724d1d2 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.096749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b22d40-7d06-41f0-97dc-f00e72643880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.097395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22d40-7d06-41f0-97dc-f00e72643880 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.097674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22d40-7d06-41f0-97dc-f00e72643880 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.097944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b22d40-7d06-41f0-97dc-f00e72643880 None admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.098676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22d40-7d06-41f0-97dc-f00e72643880 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:25.098997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22d40-7d06-41f0-97dc-f00e72643880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:25.100359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b22d40-7d06-41f0-97dc-f00e72643880 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:25.108624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 643/1277] 10.222.0.48 () {56 vars in 1099 bytes} [Thu Jul 21 04:08:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:25.114217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcf78a-e431-4ec4-92ae-2f4ed9214542 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.210874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbcf78a-e431-4ec4-92ae-2f4ed9214542 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.242981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a52b6-0a56-4579-98c6-2fed6b6064fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.243771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a52b6-0a56-4579-98c6-2fed6b6064fb None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.244603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a52b6-0a56-4579-98c6-2fed6b6064fb None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.244890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a52b6-0a56-4579-98c6-2fed6b6064fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.255122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a52b6-0a56-4579-98c6-2fed6b6064fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:25.256583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a52b6-0a56-4579-98c6-2fed6b6064fb None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-e82a52b6-0a56-4579-98c6-2fed6b6064fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:25.273155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:25.274253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:25.276147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:25.276147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:25.276147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:25.276147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:25.276147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 635/1278] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:25.280560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b22d40-7d06-41f0-97dc-f00e72643880 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.375759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b22d40-7d06-41f0-97dc-f00e72643880 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.408151 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f009c83-d572-41f8-82dc-829abd557bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.408789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f009c83-d572-41f8-82dc-829abd557bbc None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.409069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f009c83-d572-41f8-82dc-829abd557bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.409341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f009c83-d572-41f8-82dc-829abd557bbc None admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.410052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f009c83-d572-41f8-82dc-829abd557bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:25.410360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f009c83-d572-41f8-82dc-829abd557bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:25.411750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f009c83-d572-41f8-82dc-829abd557bbc None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:25.423525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 644/1279] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:25.429040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a52b6-0a56-4579-98c6-2fed6b6064fb None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.459267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:25.527151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a52b6-0a56-4579-98c6-2fed6b6064fb None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.559300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9fe7e-1361-45da-931e-dd440065b6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.560075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9fe7e-1361-45da-931e-dd440065b6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.560358 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9fe7e-1361-45da-931e-dd440065b6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.560631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9fe7e-1361-45da-931e-dd440065b6f5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.567852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9fe7e-1361-45da-931e-dd440065b6f5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:25.569283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9fe7e-1361-45da-931e-dd440065b6f5 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-bac9fe7e-1361-45da-931e-dd440065b6f5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 21 04:08:25.583612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:25.584736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:25.585997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 636/1280] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:25.590971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f009c83-d572-41f8-82dc-829abd557bbc None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.594704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:25.688248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f009c83-d572-41f8-82dc-829abd557bbc None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.721131 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552a266-7d18-4f25-9bf9-ae463593f6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.721779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552a266-7d18-4f25-9bf9-ae463593f6ae None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.722058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552a266-7d18-4f25-9bf9-ae463593f6ae None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.722331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8552a266-7d18-4f25-9bf9-ae463593f6ae None admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.723177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552a266-7d18-4f25-9bf9-ae463593f6ae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:25.723484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552a266-7d18-4f25-9bf9-ae463593f6ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:25.724900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8552a266-7d18-4f25-9bf9-ae463593f6ae None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:25.740965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 645/1281] 10.222.0.48 () {56 vars in 1143 bytes} [Thu Jul 21 04:08:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:25.746714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9fe7e-1361-45da-931e-dd440065b6f5 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:25.840853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:25.850242 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9fe7e-1361-45da-931e-dd440065b6f5 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:25.881703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530c01-2eea-4d4e-903d-c405951a628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:25.882335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530c01-2eea-4d4e-903d-c405951a628a None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:25.882618 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530c01-2eea-4d4e-903d-c405951a628a None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:25.882889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530c01-2eea-4d4e-903d-c405951a628a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:25.952136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57530c01-2eea-4d4e-903d-c405951a628a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:25.953582 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57530c01-2eea-4d4e-903d-c405951a628a None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:26.037506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:26.047775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 637/1282] 10.222.0.48 () {58 vars in 1282 bytes} [Thu Jul 21 04:08:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 21 04:08:26.053568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552a266-7d18-4f25-9bf9-ae463593f6ae None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:26.113222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:26.150596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8552a266-7d18-4f25-9bf9-ae463593f6ae None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:26.182901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27c1eb-8ad7-4008-8d7d-7a6368ce7424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:26.183766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c1eb-8ad7-4008-8d7d-7a6368ce7424 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:26.184018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c1eb-8ad7-4008-8d7d-7a6368ce7424 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:26.184292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c27c1eb-8ad7-4008-8d7d-7a6368ce7424 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:26.194169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27c1eb-8ad7-4008-8d7d-7a6368ce7424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:26.195656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c27c1eb-8ad7-4008-8d7d-7a6368ce7424 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-2c27c1eb-8ad7-4008-8d7d-7a6368ce7424 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 21 04:08:26.213477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:26.214559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:26.215890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 21 04:08:26.215890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 21 04:08:26.215890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 21 04:08:26.215890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:26.215890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 646/1283] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:08:26.220247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530c01-2eea-4d4e-903d-c405951a628a None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:26.315038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530c01-2eea-4d4e-903d-c405951a628a None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:26.348492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bddb5-c397-4893-97b3-d94c065e4f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:26.349133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bddb5-c397-4893-97b3-d94c065e4f23 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:26.349418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bddb5-c397-4893-97b3-d94c065e4f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:26.349694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bddb5-c397-4893-97b3-d94c065e4f23 None admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:26.350405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bddb5-c397-4893-97b3-d94c065e4f23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:26.350709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bddb5-c397-4893-97b3-d94c065e4f23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:26.352097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bddb5-c397-4893-97b3-d94c065e4f23 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:26.363488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 638/1284] 10.222.0.48 () {56 vars in 1109 bytes} [Thu Jul 21 04:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:26.369401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27c1eb-8ad7-4008-8d7d-7a6368ce7424 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:26.464782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c27c1eb-8ad7-4008-8d7d-7a6368ce7424 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:26.477911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:26.498556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368c1a-ecfa-4084-a50c-93594c7ade70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:26.499353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368c1a-ecfa-4084-a50c-93594c7ade70 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:26.499634 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368c1a-ecfa-4084-a50c-93594c7ade70 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:26.499908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93368c1a-ecfa-4084-a50c-93594c7ade70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:26.506315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93368c1a-ecfa-4084-a50c-93594c7ade70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:26.507788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93368c1a-ecfa-4084-a50c-93594c7ade70 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application [None req-93368c1a-ecfa-4084-a50c-93594c7ade70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 21 04:08:26.521069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:26.522115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:26.523311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 21 04:08:26.523311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 21 04:08:26.523311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 21 04:08:26.523311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 21 04:08:26.523311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 21 04:08:26.523311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 21 04:08:26.523311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 21 04:08:26.523311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: ERROR keystone.server.flask.application Jul 21 04:08:26.523311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 647/1285] 10.222.0.48 () {56 vars in 1111 bytes} [Thu Jul 21 04:08:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 21 04:08:26.527909 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bddb5-c397-4893-97b3-d94c065e4f23 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:26.576929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:26.625926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bddb5-c397-4893-97b3-d94c065e4f23 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:26.657963 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec7bbe-7bbd-4bf1-b31d-946f7e18005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:26.658600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7bbe-7bbd-4bf1-b31d-946f7e18005b None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:26.658879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7bbe-7bbd-4bf1-b31d-946f7e18005b None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:26.659181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7bbe-7bbd-4bf1-b31d-946f7e18005b None admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:26.659956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec7bbe-7bbd-4bf1-b31d-946f7e18005b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:26.660263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec7bbe-7bbd-4bf1-b31d-946f7e18005b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:26.661677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec7bbe-7bbd-4bf1-b31d-946f7e18005b None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:26.674207 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 639/1286] 10.222.0.48 () {56 vars in 1148 bytes} [Thu Jul 21 04:08:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:26.680219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368c1a-ecfa-4084-a50c-93594c7ade70 None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:26.778091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93368c1a-ecfa-4084-a50c-93594c7ade70 None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:26.810356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64de191b-5bd0-455c-a7da-b142706b3926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:26.811002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de191b-5bd0-455c-a7da-b142706b3926 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:26.811284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de191b-5bd0-455c-a7da-b142706b3926 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:26.811558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64de191b-5bd0-455c-a7da-b142706b3926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:26.812370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de191b-5bd0-455c-a7da-b142706b3926 None admin] RBAC: Adding query filter params (role.id=5756f6673fe74f729c39ec094f99c3c9, scope.project.id=9d0157137c144c9c87c3a2d26a502701, user.id=8572e4c550014fc4b1aea3ddf16f7d2f) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:26.812674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de191b-5bd0-455c-a7da-b142706b3926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:26.814099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64de191b-5bd0-455c-a7da-b142706b3926 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:26.819792 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 648/1287] 10.222.0.48 () {56 vars in 1374 bytes} [Thu Jul 21 04:08:26 2022] GET /identity/v3/role_assignments?user.id=8572e4c550014fc4b1aea3ddf16f7d2f&scope.project.id=9d0157137c144c9c87c3a2d26a502701&role.id=5756f6673fe74f729c39ec094f99c3c9 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:28.863508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cdb0e-74e3-48c4-a7c8-a441313af2a5 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:28.864097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cdb0e-74e3-48c4-a7c8-a441313af2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:28.864097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3cdb0e-74e3-48c4-a7c8-a441313af2a5 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:28.865422 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 640/1288] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:28.871064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb47a4-6ee4-4225-839e-7fa7826050a1 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:28.871562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb47a4-6ee4-4225-839e-7fa7826050a1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:28.871663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcb47a4-6ee4-4225-839e-7fa7826050a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:28.890310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-5bcb47a4-6ee4-4225-839e-7fa7826050a1 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:28.891644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-5bcb47a4-6ee4-4225-839e-7fa7826050a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:28.922286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:28.961126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 649/1289] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:28.983900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cdb0e-74e3-48c4-a7c8-a441313af2a5 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:29.094273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3cdb0e-74e3-48c4-a7c8-a441313af2a5 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:29.104676 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:29.128093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387c5c4-9088-4e7e-8cb7-398befa8efb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:29.128819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c5c4-9088-4e7e-8cb7-398befa8efb1 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:29.129103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c5c4-9088-4e7e-8cb7-398befa8efb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:29.129380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0387c5c4-9088-4e7e-8cb7-398befa8efb1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:29.130027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387c5c4-9088-4e7e-8cb7-398befa8efb1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:29.131442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0387c5c4-9088-4e7e-8cb7-398befa8efb1 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-0387c5c4-9088-4e7e-8cb7-398befa8efb1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:29.143666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:29.144917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:29.146194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 641/1290] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 21 04:08:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:29.150920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb47a4-6ee4-4225-839e-7fa7826050a1 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:29.248396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcb47a4-6ee4-4225-839e-7fa7826050a1 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:29.280747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374dddc-c5d5-463c-96b7-7500af1027b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:29.281400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374dddc-c5d5-463c-96b7-7500af1027b9 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:29.281684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374dddc-c5d5-463c-96b7-7500af1027b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:29.281964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374dddc-c5d5-463c-96b7-7500af1027b9 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:29.282660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374dddc-c5d5-463c-96b7-7500af1027b9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:29.282985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374dddc-c5d5-463c-96b7-7500af1027b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:29.284357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374dddc-c5d5-463c-96b7-7500af1027b9 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:29.289053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 650/1291] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jul 21 04:08:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:08:29.294781 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387c5c4-9088-4e7e-8cb7-398befa8efb1 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:29.394678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0387c5c4-9088-4e7e-8cb7-398befa8efb1 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:29.427330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecbb1b9-0cf3-4a97-9ced-2dfde55afc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:29.427983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbb1b9-0cf3-4a97-9ced-2dfde55afc41 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:29.428270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbb1b9-0cf3-4a97-9ced-2dfde55afc41 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:29.428549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecbb1b9-0cf3-4a97-9ced-2dfde55afc41 None admin] PATH_INFO: `/v3/services` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:29.429253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbb1b9-0cf3-4a97-9ced-2dfde55afc41 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:29.429588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbb1b9-0cf3-4a97-9ced-2dfde55afc41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:29.430996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecbb1b9-0cf3-4a97-9ced-2dfde55afc41 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:29.435992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 642/1292] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jul 21 04:08:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:31.436451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eb009-3142-4067-b37e-1da2d58196ba None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:31.436961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eb009-3142-4067-b37e-1da2d58196ba None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:31.436961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503eb009-3142-4067-b37e-1da2d58196ba None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:31.438295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 651/1293] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:31.443339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85515a35-19cc-4b68-931b-203363a60f8d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:31.443715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85515a35-19cc-4b68-931b-203363a60f8d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:31.443892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85515a35-19cc-4b68-931b-203363a60f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:31.460593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-85515a35-19cc-4b68-931b-203363a60f8d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:31.461777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-85515a35-19cc-4b68-931b-203363a60f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:31.491237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:31.527727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 643/1294] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:31.549872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503eb009-3142-4067-b37e-1da2d58196ba None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:31.580888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:31.650578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503eb009-3142-4067-b37e-1da2d58196ba None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:31.683875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abd818-0927-4483-be24-6f6e3dbe69be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:31.684531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd818-0927-4483-be24-6f6e3dbe69be None admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:31.684817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd818-0927-4483-be24-6f6e3dbe69be None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:31.685093 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abd818-0927-4483-be24-6f6e3dbe69be None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:31.685814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abd818-0927-4483-be24-6f6e3dbe69be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:31.687264 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abd818-0927-4483-be24-6f6e3dbe69be None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:31.699997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 652/1295] 10.222.0.48 () {60 vars in 1141 bytes} [Thu Jul 21 04:08:31 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:08:33.774498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7954ee-f88d-45bc-9957-809159431d22 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:33.775232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7954ee-f88d-45bc-9957-809159431d22 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:33.775519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7954ee-f88d-45bc-9957-809159431d22 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:33.776902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 644/1296] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:33.782013 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437669-7f54-4529-8cf1-e23acd1bf5a1 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:33.782380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437669-7f54-4529-8cf1-e23acd1bf5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:33.782569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437669-7f54-4529-8cf1-e23acd1bf5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:33.798727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-11437669-7f54-4529-8cf1-e23acd1bf5a1 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:33.799923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-11437669-7f54-4529-8cf1-e23acd1bf5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:33.874171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 653/1297] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:33.901459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7954ee-f88d-45bc-9957-809159431d22 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:34.012264 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7954ee-f88d-45bc-9957-809159431d22 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:34.045910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43786d94-d9dd-42aa-85a9-d462379f7262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:34.046637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43786d94-d9dd-42aa-85a9-d462379f7262 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:34.046917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43786d94-d9dd-42aa-85a9-d462379f7262 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:34.047224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43786d94-d9dd-42aa-85a9-d462379f7262 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:34.047872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43786d94-d9dd-42aa-85a9-d462379f7262 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:34.049249 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43786d94-d9dd-42aa-85a9-d462379f7262 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-43786d94-d9dd-42aa-85a9-d462379f7262 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:34.061990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:34.063213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:34.064431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 645/1298] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 21 04:08:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:34.069284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11437669-7f54-4529-8cf1-e23acd1bf5a1 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:34.087742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:34.168963 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11437669-7f54-4529-8cf1-e23acd1bf5a1 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:34.202366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134d5db-e25a-462c-b4db-d10f598b193d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:34.203060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134d5db-e25a-462c-b4db-d10f598b193d None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:34.203344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134d5db-e25a-462c-b4db-d10f598b193d None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:34.203618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134d5db-e25a-462c-b4db-d10f598b193d None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:34.204319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134d5db-e25a-462c-b4db-d10f598b193d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:34.204625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134d5db-e25a-462c-b4db-d10f598b193d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:34.206003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134d5db-e25a-462c-b4db-d10f598b193d None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:34.211394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 654/1299] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jul 21 04:08:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:34.217961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43786d94-d9dd-42aa-85a9-d462379f7262 None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:34.250290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:34.325098 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43786d94-d9dd-42aa-85a9-d462379f7262 None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:34.359383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee86422-8012-47f3-ae4d-2b7bbf88af88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:34.360030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee86422-8012-47f3-ae4d-2b7bbf88af88 None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:34.360314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee86422-8012-47f3-ae4d-2b7bbf88af88 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:34.360591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee86422-8012-47f3-ae4d-2b7bbf88af88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:34.361374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee86422-8012-47f3-ae4d-2b7bbf88af88 None admin] RBAC: Adding query filter params (interface=public, service_id=fb5e028b3b62441abc5ab0876904ca12, region_id=RegionOne) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:34.361688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee86422-8012-47f3-ae4d-2b7bbf88af88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:34.363083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee86422-8012-47f3-ae4d-2b7bbf88af88 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:34.368004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 646/1300] 10.222.0.48 () {56 vars in 1251 bytes} [Thu Jul 21 04:08:34 2022] GET /identity/v3/endpoints?service_id=fb5e028b3b62441abc5ab0876904ca12&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:34.373969 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134d5db-e25a-462c-b4db-d10f598b193d None admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:34.454521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:34.473142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134d5db-e25a-462c-b4db-d10f598b193d None admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:34.506192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a0f8a9-845d-499e-a1ce-435feb567b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:34.506849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0f8a9-845d-499e-a1ce-435feb567b62 None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:34.507162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0f8a9-845d-499e-a1ce-435feb567b62 None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:34.507440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a0f8a9-845d-499e-a1ce-435feb567b62 None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:34.508123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0f8a9-845d-499e-a1ce-435feb567b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:34.509788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a0f8a9-845d-499e-a1ce-435feb567b62 None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:34.516534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 655/1301] 10.222.0.48 () {56 vars in 1087 bytes} [Thu Jul 21 04:08:34 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:08:36.520918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645857-fd4b-4dff-aa40-f0e766e79994 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:36.521444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645857-fd4b-4dff-aa40-f0e766e79994 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:36.521444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae645857-fd4b-4dff-aa40-f0e766e79994 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:36.522747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 647/1302] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:08:36.528387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d5283-f644-47b8-aeaa-ccac8664aa90 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:36.528822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d5283-f644-47b8-aeaa-ccac8664aa90 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:36.528942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93d5283-f644-47b8-aeaa-ccac8664aa90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:36.545426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c93d5283-f644-47b8-aeaa-ccac8664aa90 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:08:36.546600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c93d5283-f644-47b8-aeaa-ccac8664aa90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:08:36.611210 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 656/1303] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:08:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 21 04:08:36.634969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae645857-fd4b-4dff-aa40-f0e766e79994 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:36.726581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:36.733590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae645857-fd4b-4dff-aa40-f0e766e79994 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:36.768315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068399b-ad00-4ccc-a348-f941d3630f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:36.769104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068399b-ad00-4ccc-a348-f941d3630f8f None admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:36.769387 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068399b-ad00-4ccc-a348-f941d3630f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:36.769662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068399b-ad00-4ccc-a348-f941d3630f8f None admin] PATH_INFO: `/v3/services/placement` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:36.770310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068399b-ad00-4ccc-a348-f941d3630f8f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:36.771764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068399b-ad00-4ccc-a348-f941d3630f8f None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application [None req-5068399b-ad00-4ccc-a348-f941d3630f8f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 21 04:08:36.783421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 21 04:08:36.784583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.get_or_create( Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application with Lock( Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self._enter() Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application return self.creator() Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application created_value = creator( Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: ERROR keystone.server.flask.application Jul 21 04:08:36.785782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 648/1304] 10.222.0.48 () {56 vars in 1117 bytes} [Thu Jul 21 04:08:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 21 04:08:36.790734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d5283-f644-47b8-aeaa-ccac8664aa90 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:36.864266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:36.891742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93d5283-f644-47b8-aeaa-ccac8664aa90 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:36.935113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e76d443-a541-4671-8ce9-d961fc7255fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:36.935947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d443-a541-4671-8ce9-d961fc7255fa None admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:36.936227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d443-a541-4671-8ce9-d961fc7255fa None admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:36.936608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e76d443-a541-4671-8ce9-d961fc7255fa None admin] PATH_INFO: `/v3/services` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:36.937414 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76d443-a541-4671-8ce9-d961fc7255fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:08:36.937785 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76d443-a541-4671-8ce9-d961fc7255fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:36.939421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e76d443-a541-4671-8ce9-d961fc7255fa None admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:36.945372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 657/1305] 10.222.0.48 () {56 vars in 1116 bytes} [Thu Jul 21 04:08:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:08:36.951474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068399b-ad00-4ccc-a348-f941d3630f8f None admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:08:37.057741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068399b-ad00-4ccc-a348-f941d3630f8f None admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:08:37.090375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95814256-7941-4114-85dd-f81fe8292930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:08:37.091049 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95814256-7941-4114-85dd-f81fe8292930 None admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:08:37.091332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95814256-7941-4114-85dd-f81fe8292930 None admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:08:37.091607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95814256-7941-4114-85dd-f81fe8292930 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:08:37.092343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95814256-7941-4114-85dd-f81fe8292930 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:08:37.093708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95814256-7941-4114-85dd-f81fe8292930 None admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:08:37.111380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 649/1306] 10.222.0.48 () {60 vars in 1144 bytes} [Thu Jul 21 04:08:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:08:46.941830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=30 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:08:47.107167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:40.064287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8462b-13de-4ba1-9c23-06cf80bd0f25 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:40.064748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8462b-13de-4ba1-9c23-06cf80bd0f25 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:40.065125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8462b-13de-4ba1-9c23-06cf80bd0f25 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:40.066850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 658/1307] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:09:40.075811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fe98-82b0-42e0-8c1f-e36a9d0b0801 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:40.077348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fe98-82b0-42e0-8c1f-e36a9d0b0801 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:40.078321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b46fe98-82b0-42e0-8c1f-e36a9d0b0801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:40.278628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-0b46fe98-82b0-42e0-8c1f-e36a9d0b0801 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:09:40.280378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0b46fe98-82b0-42e0-8c1f-e36a9d0b0801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:40.425953 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 650/1308] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:09:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:09:40.479700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e293d50-3ebf-4ffc-96c5-8cf6e7cde081 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:40.480603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e293d50-3ebf-4ffc-96c5-8cf6e7cde081 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:40.481120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e293d50-3ebf-4ffc-96c5-8cf6e7cde081 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:40.483149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 659/1309] 10.222.0.48 () {54 vars in 965 bytes} [Thu Jul 21 04:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:09:40.489546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5809-d2df-4d88-8ea9-8ca77d9b9484 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:40.489836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5809-d2df-4d88-8ea9-8ca77d9b9484 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:40.490119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4a5809-d2df-4d88-8ea9-8ca77d9b9484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:40.567799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-2b4a5809-d2df-4d88-8ea9-8ca77d9b9484 None None] MFA Rules not processed for user `b3b2d5dee6d240558a71331e05035a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:09:40.568997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2b4a5809-d2df-4d88-8ea9-8ca77d9b9484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:40.590355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:40.648974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 651/1310] 10.222.0.48 () {58 vars in 1062 bytes} [Thu Jul 21 04:09:40 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:09:40.657874 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e293d50-3ebf-4ffc-96c5-8cf6e7cde081 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:09:40.660607 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6e293d50-3ebf-4ffc-96c5-8cf6e7cde081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:40.780725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e293d50-3ebf-4ffc-96c5-8cf6e7cde081 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:09:40.868047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b74f3a-eb7b-4342-a07b-d495c36aa14b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:09:40.868698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b74f3a-eb7b-4342-a07b-d495c36aa14b service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:40.868979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b74f3a-eb7b-4342-a07b-d495c36aa14b service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:40.869251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b74f3a-eb7b-4342-a07b-d495c36aa14b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:40.870906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-86b74f3a-eb7b-4342-a07b-d495c36aa14b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:40.938056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:41.012025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b74f3a-eb7b-4342-a07b-d495c36aa14b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:09:41.013535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b74f3a-eb7b-4342-a07b-d495c36aa14b service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:09:41.039179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 660/1311] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:09:43.429330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a3584-45fc-43d9-935b-d7c79ed2cd7e None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:43.429874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a3584-45fc-43d9-935b-d7c79ed2cd7e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:43.429874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a3584-45fc-43d9-935b-d7c79ed2cd7e None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:43.431408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 652/1312] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:09:43.437283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70756-5060-4fef-b6c2-bc4c66efc58d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:43.437818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70756-5060-4fef-b6c2-bc4c66efc58d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:43.437900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70756-5060-4fef-b6c2-bc4c66efc58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:43.523027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-caa70756-5060-4fef-b6c2-bc4c66efc58d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:09:43.524302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-caa70756-5060-4fef-b6c2-bc4c66efc58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:43.643252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 661/1313] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:09:43.682643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a3584-45fc-43d9-935b-d7c79ed2cd7e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:09:43.684213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-103a3584-45fc-43d9-935b-d7c79ed2cd7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:43.796631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a3584-45fc-43d9-935b-d7c79ed2cd7e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:09:43.875362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:43.878604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9da140-20ed-4d75-9513-221b0dc41b7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:09:43.879505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da140-20ed-4d75-9513-221b0dc41b7e service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:43.880131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da140-20ed-4d75-9513-221b0dc41b7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:43.880640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9da140-20ed-4d75-9513-221b0dc41b7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:43.882563 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7f9da140-20ed-4d75-9513-221b0dc41b7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:43.994521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9da140-20ed-4d75-9513-221b0dc41b7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:09:43.995898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9da140-20ed-4d75-9513-221b0dc41b7e service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:09:44.013392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 653/1314] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:09:46.376408 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d1405-2902-4cf9-8377-54b3daad6ddb None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:46.377542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d1405-2902-4cf9-8377-54b3daad6ddb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:46.377778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d1405-2902-4cf9-8377-54b3daad6ddb None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:46.379494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 662/1315] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:09:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:09:46.384827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25353c6-c9f4-4528-82ff-8483713a9eb0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:46.385278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25353c6-c9f4-4528-82ff-8483713a9eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:46.385378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25353c6-c9f4-4528-82ff-8483713a9eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:46.448572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-a25353c6-c9f4-4528-82ff-8483713a9eb0 None None] MFA Rules not processed for user `f869ee38ef2a44d298334f947030268e`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:09:46.449698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a25353c6-c9f4-4528-82ff-8483713a9eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:46.499927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:46.543157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 654/1316] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:09:46 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:09:46.585340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d1405-2902-4cf9-8377-54b3daad6ddb None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:09:46.586914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-602d1405-2902-4cf9-8377-54b3daad6ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:46.596569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:46.689465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d1405-2902-4cf9-8377-54b3daad6ddb None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:09:46.760014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06734d24-4e0b-47df-ba45-38900f0a0d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:09:46.760584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06734d24-4e0b-47df-ba45-38900f0a0d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:46.760863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06734d24-4e0b-47df-ba45-38900f0a0d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:46.761137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06734d24-4e0b-47df-ba45-38900f0a0d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:46.762760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-06734d24-4e0b-47df-ba45-38900f0a0d4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:46.823509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:46.869956 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06734d24-4e0b-47df-ba45-38900f0a0d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:09:46.871429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06734d24-4e0b-47df-ba45-38900f0a0d4c service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:09:46.892232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 663/1317] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:09:46 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:09:49.484299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c1894-6774-4c91-9df4-b8e9f12b6401 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:49.484802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c1894-6774-4c91-9df4-b8e9f12b6401 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:49.484802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c1894-6774-4c91-9df4-b8e9f12b6401 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:49.486390 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 655/1318] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:09:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:09:49.491658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cc6f-6adc-4135-baa9-eb497f16eb0d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:49.492055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cc6f-6adc-4135-baa9-eb497f16eb0d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:49.492217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1349cc6f-6adc-4135-baa9-eb497f16eb0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:49.555461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1349cc6f-6adc-4135-baa9-eb497f16eb0d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:09:49.556676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1349cc6f-6adc-4135-baa9-eb497f16eb0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:49.650604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 664/1319] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:09:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:09:49.690460 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c1894-6774-4c91-9df4-b8e9f12b6401 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:09:49.692031 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-aa4c1894-6774-4c91-9df4-b8e9f12b6401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:49.793553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c1894-6774-4c91-9df4-b8e9f12b6401 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:09:49.866175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e4949-8bf6-4950-b36f-1db21f3ffbfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:09:49.866818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e4949-8bf6-4950-b36f-1db21f3ffbfa service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:49.867140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e4949-8bf6-4950-b36f-1db21f3ffbfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:49.867400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e4949-8bf6-4950-b36f-1db21f3ffbfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:49.869015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5e3e4949-8bf6-4950-b36f-1db21f3ffbfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:49.878045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:49.981000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e4949-8bf6-4950-b36f-1db21f3ffbfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:09:49.982457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e4949-8bf6-4950-b36f-1db21f3ffbfa service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:09:50.000036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 656/1320] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:09:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:09:52.723834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36920e2-784d-40ae-87c2-e6eb3f6a5ea8 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:52.724399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36920e2-784d-40ae-87c2-e6eb3f6a5ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:52.724399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36920e2-784d-40ae-87c2-e6eb3f6a5ea8 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:52.725766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 665/1321] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:09:52.731131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb1cf-7104-4e80-97cf-2c4fc211a945 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:52.731525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb1cf-7104-4e80-97cf-2c4fc211a945 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:52.731722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08eb1cf-7104-4e80-97cf-2c4fc211a945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:52.796706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e08eb1cf-7104-4e80-97cf-2c4fc211a945 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:09:52.797963 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e08eb1cf-7104-4e80-97cf-2c4fc211a945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:52.859213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:52.905370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 657/1322] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:09:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:09:52.956727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cc542-a949-4adf-a837-a9b951989116 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:52.957015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cc542-a949-4adf-a837-a9b951989116 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:52.957296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cc542-a949-4adf-a837-a9b951989116 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:52.958704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 666/1323] 10.222.0.48 () {54 vars in 965 bytes} [Thu Jul 21 04:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:09:52.965172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c5d48-fbc6-440e-b2a5-bbd7ba07a6cd None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:52.965465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c5d48-fbc6-440e-b2a5-bbd7ba07a6cd None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:52.965750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220c5d48-fbc6-440e-b2a5-bbd7ba07a6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:53.047213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-220c5d48-fbc6-440e-b2a5-bbd7ba07a6cd None None] MFA Rules not processed for user `b3b2d5dee6d240558a71331e05035a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:09:53.048719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-220c5d48-fbc6-440e-b2a5-bbd7ba07a6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:53.126327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 658/1324] 10.222.0.48 () {58 vars in 1062 bytes} [Thu Jul 21 04:09:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:09:53.135093 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cc542-a949-4adf-a837-a9b951989116 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:09:53.136643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f61cc542-a949-4adf-a837-a9b951989116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:53.156640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:53.245594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cc542-a949-4adf-a837-a9b951989116 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:09:53.319318 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285b932-c870-491d-a476-ab271fbb63b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:09:53.319871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b932-c870-491d-a476-ab271fbb63b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:53.320156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b932-c870-491d-a476-ab271fbb63b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:53.320436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285b932-c870-491d-a476-ab271fbb63b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:53.322087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b285b932-c870-491d-a476-ab271fbb63b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:53.393552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:53.431370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285b932-c870-491d-a476-ab271fbb63b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:09:53.432817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285b932-c870-491d-a476-ab271fbb63b1 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:09:53.451120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 667/1325] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:09:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:09:55.791899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbf932-cbf1-4342-852a-76effef3b30c None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:55.792455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbf932-cbf1-4342-852a-76effef3b30c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:55.792549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bbf932-cbf1-4342-852a-76effef3b30c None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:55.793918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 659/1326] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:09:55.799418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec7912-9868-4204-bc68-3aac16791a3f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:55.799843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec7912-9868-4204-bc68-3aac16791a3f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:55.800027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec7912-9868-4204-bc68-3aac16791a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:55.866058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-88ec7912-9868-4204-bc68-3aac16791a3f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:09:55.867300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-88ec7912-9868-4204-bc68-3aac16791a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:55.976046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 668/1327] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:09:56.012336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbf932-cbf1-4342-852a-76effef3b30c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:09:56.013878 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-40bbf932-cbf1-4342-852a-76effef3b30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:56.076657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:56.120552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bbf932-cbf1-4342-852a-76effef3b30c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:09:56.194405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a285417-1469-4a3a-a8ef-89108db1279c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:09:56.195085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a285417-1469-4a3a-a8ef-89108db1279c service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:56.195372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a285417-1469-4a3a-a8ef-89108db1279c service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:56.195650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a285417-1469-4a3a-a8ef-89108db1279c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:56.197352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2a285417-1469-4a3a-a8ef-89108db1279c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:56.305405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:56.309656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a285417-1469-4a3a-a8ef-89108db1279c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:09:56.312276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a285417-1469-4a3a-a8ef-89108db1279c service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:09:56.331307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 660/1328] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:09:58.447385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f858-532f-48b1-ad87-c5718f23ea37 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:58.447889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f858-532f-48b1-ad87-c5718f23ea37 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:58.448015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d7f858-532f-48b1-ad87-c5718f23ea37 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:58.449322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 669/1329] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:09:58.455531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c60a5-92ec-414f-a37f-a4f1f661ce30 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:58.455927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c60a5-92ec-414f-a37f-a4f1f661ce30 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:58.456096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c60a5-92ec-414f-a37f-a4f1f661ce30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:58.537199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e23c60a5-92ec-414f-a37f-a4f1f661ce30 None None] MFA Rules not processed for user `f869ee38ef2a44d298334f947030268e`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:09:58.538451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e23c60a5-92ec-414f-a37f-a4f1f661ce30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:58.642280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 661/1330] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:09:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:09:58.681224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7f858-532f-48b1-ad87-c5718f23ea37 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:09:58.682759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-42d7f858-532f-48b1-ad87-c5718f23ea37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:58.717047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:58.793333 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d7f858-532f-48b1-ad87-c5718f23ea37 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:09:58.869078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48b8651-8cb7-4664-838a-79a30be989ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:09:58.869651 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8651-8cb7-4664-838a-79a30be989ad service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:09:58.869931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8651-8cb7-4664-838a-79a30be989ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:09:58.870208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48b8651-8cb7-4664-838a-79a30be989ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:09:58.871862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a48b8651-8cb7-4664-838a-79a30be989ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:09:58.947150 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:09:58.979418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b8651-8cb7-4664-838a-79a30be989ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:09:58.980868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48b8651-8cb7-4664-838a-79a30be989ad service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:09:58.999101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 670/1331] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:09:58 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:01.473352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761004-2f19-4273-88d7-41c56e01c0da None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:01.473917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761004-2f19-4273-88d7-41c56e01c0da None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:01.473917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9761004-2f19-4273-88d7-41c56e01c0da None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:01.475278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 662/1332] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:01.480370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e7f03-9af5-46e4-aa91-bb53f34636ae None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:01.480838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e7f03-9af5-46e4-aa91-bb53f34636ae None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:01.480958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e7f03-9af5-46e4-aa91-bb53f34636ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:01.544962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-539e7f03-9af5-46e4-aa91-bb53f34636ae None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:01.546188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-539e7f03-9af5-46e4-aa91-bb53f34636ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:01.645438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 671/1333] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:01.682232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9761004-2f19-4273-88d7-41c56e01c0da None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:01.683823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d9761004-2f19-4273-88d7-41c56e01c0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:01.752875 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:01.787082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9761004-2f19-4273-88d7-41c56e01c0da None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:01.860106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861c74c8-5554-4edf-8713-06293cceab72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:01.860758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c74c8-5554-4edf-8713-06293cceab72 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:01.861043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c74c8-5554-4edf-8713-06293cceab72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:01.861320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861c74c8-5554-4edf-8713-06293cceab72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:01.862975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-861c74c8-5554-4edf-8713-06293cceab72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:01.977665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c74c8-5554-4edf-8713-06293cceab72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:01.979231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861c74c8-5554-4edf-8713-06293cceab72 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:01.989237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:01.998285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 663/1334] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:04.086517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21744198-b1bd-47a3-8611-54949765b636 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:04.087101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21744198-b1bd-47a3-8611-54949765b636 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:04.087101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21744198-b1bd-47a3-8611-54949765b636 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:04.088473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 672/1335] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:04.093632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431ba12-6935-4291-bf0f-5bc646d516e9 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:04.094380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431ba12-6935-4291-bf0f-5bc646d516e9 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:04.094669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431ba12-6935-4291-bf0f-5bc646d516e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:04.159993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e431ba12-6935-4291-bf0f-5bc646d516e9 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:04.161120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e431ba12-6935-4291-bf0f-5bc646d516e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:04.257630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 664/1336] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:04.298769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21744198-b1bd-47a3-8611-54949765b636 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:04.300321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-21744198-b1bd-47a3-8611-54949765b636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:04.340205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:04.403500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21744198-b1bd-47a3-8611-54949765b636 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:04.474783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77207646-7dca-4dd6-bbe3-7eeee21c07e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:04.475454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77207646-7dca-4dd6-bbe3-7eeee21c07e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:04.475733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77207646-7dca-4dd6-bbe3-7eeee21c07e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:04.476005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77207646-7dca-4dd6-bbe3-7eeee21c07e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:04.477642 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-77207646-7dca-4dd6-bbe3-7eeee21c07e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:04.559070 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:04.586016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77207646-7dca-4dd6-bbe3-7eeee21c07e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:04.587511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77207646-7dca-4dd6-bbe3-7eeee21c07e3 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:04.605407 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 673/1337] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:07.029880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f118661-6f15-4b06-bea5-7df2c1e4f08e None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:07.030432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f118661-6f15-4b06-bea5-7df2c1e4f08e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:07.030432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f118661-6f15-4b06-bea5-7df2c1e4f08e None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:07.032446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 665/1338] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:07.037830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14468aa6-cadb-4d85-95a2-7068cff92416 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:07.038215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14468aa6-cadb-4d85-95a2-7068cff92416 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:07.038382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14468aa6-cadb-4d85-95a2-7068cff92416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:07.102010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-14468aa6-cadb-4d85-95a2-7068cff92416 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:07.103234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-14468aa6-cadb-4d85-95a2-7068cff92416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:07.198145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 674/1339] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:07.235421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f118661-6f15-4b06-bea5-7df2c1e4f08e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:07.237029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9f118661-6f15-4b06-bea5-7df2c1e4f08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:07.311967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:07.340752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f118661-6f15-4b06-bea5-7df2c1e4f08e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:07.413125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8915145-1e43-4c84-b989-a1a13d64d1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:07.413768 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8915145-1e43-4c84-b989-a1a13d64d1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:07.414049 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8915145-1e43-4c84-b989-a1a13d64d1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:07.414319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8915145-1e43-4c84-b989-a1a13d64d1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:07.415985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a8915145-1e43-4c84-b989-a1a13d64d1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:07.525509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8915145-1e43-4c84-b989-a1a13d64d1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:07.526879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8915145-1e43-4c84-b989-a1a13d64d1b0 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:07.545296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 666/1340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:11.569505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc23d9-95c1-43a0-b810-6e19277ec210 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:11.570033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc23d9-95c1-43a0-b810-6e19277ec210 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:11.570033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fc23d9-95c1-43a0-b810-6e19277ec210 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:11.571466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 675/1341] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:11.576826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e651a-55a0-4a7b-a7f9-1ab93c57859a None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:11.577232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e651a-55a0-4a7b-a7f9-1ab93c57859a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:11.577386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4e651a-55a0-4a7b-a7f9-1ab93c57859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:11.582323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:11.646685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7e4e651a-55a0-4a7b-a7f9-1ab93c57859a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:11.647934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7e4e651a-55a0-4a7b-a7f9-1ab93c57859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:11.744233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 667/1342] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:11.784605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc23d9-95c1-43a0-b810-6e19277ec210 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:11.786194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-20fc23d9-95c1-43a0-b810-6e19277ec210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:11.837344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:11.894696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fc23d9-95c1-43a0-b810-6e19277ec210 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:11.967375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b0369-ead7-400e-aa80-4bdafc7b08ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:11.968073 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0369-ead7-400e-aa80-4bdafc7b08ae service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:11.968355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0369-ead7-400e-aa80-4bdafc7b08ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:11.968680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b0369-ead7-400e-aa80-4bdafc7b08ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:11.970316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-081b0369-ead7-400e-aa80-4bdafc7b08ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:12.067142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:12.084006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0369-ead7-400e-aa80-4bdafc7b08ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:12.085456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b0369-ead7-400e-aa80-4bdafc7b08ae service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:12.103355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 676/1343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:14.813562 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87a828-9cc4-40e6-96ba-56d18d2cc6fc None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:14.814159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87a828-9cc4-40e6-96ba-56d18d2cc6fc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:14.814159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87a828-9cc4-40e6-96ba-56d18d2cc6fc None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:14.815533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 668/1344] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:14.821156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c797eb-1f5b-4c22-bb0b-4ea73316b988 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:14.821545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c797eb-1f5b-4c22-bb0b-4ea73316b988 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:14.821715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c797eb-1f5b-4c22-bb0b-4ea73316b988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:14.891034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c6c797eb-1f5b-4c22-bb0b-4ea73316b988 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:14.892230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c6c797eb-1f5b-4c22-bb0b-4ea73316b988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:14.990896 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 677/1345] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:14 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:15.028448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87a828-9cc4-40e6-96ba-56d18d2cc6fc None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:15.030068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ac87a828-9cc4-40e6-96ba-56d18d2cc6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:15.118706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:15.136533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87a828-9cc4-40e6-96ba-56d18d2cc6fc None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:15.214069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679827f8-0cf5-4ee6-82b4-25617be68722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:15.214720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679827f8-0cf5-4ee6-82b4-25617be68722 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:15.215140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679827f8-0cf5-4ee6-82b4-25617be68722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:15.215417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679827f8-0cf5-4ee6-82b4-25617be68722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:15.217070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-679827f8-0cf5-4ee6-82b4-25617be68722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:15.327828 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679827f8-0cf5-4ee6-82b4-25617be68722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:15.329284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679827f8-0cf5-4ee6-82b4-25617be68722 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:15.347481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 669/1346] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:19.392436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd968d3-998d-4c71-bd30-95be2be49705 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:19.392984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd968d3-998d-4c71-bd30-95be2be49705 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:19.392984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd968d3-998d-4c71-bd30-95be2be49705 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:19.394383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 678/1347] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:19.399575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4826c6-7a4a-41a7-805d-c61becf3cb26 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:19.400045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4826c6-7a4a-41a7-805d-c61becf3cb26 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:19.400295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4826c6-7a4a-41a7-805d-c61becf3cb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:19.414797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:19.469107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-ca4826c6-7a4a-41a7-805d-c61becf3cb26 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:19.470320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ca4826c6-7a4a-41a7-805d-c61becf3cb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:19.575003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 670/1348] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:19.616976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd968d3-998d-4c71-bd30-95be2be49705 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:19.618546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6fd968d3-998d-4c71-bd30-95be2be49705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:19.684008 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:19.737107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd968d3-998d-4c71-bd30-95be2be49705 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:19.815859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5f6ef-8099-4237-ab79-f2ed9dc9970f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:19.816432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5f6ef-8099-4237-ab79-f2ed9dc9970f service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:19.816714 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5f6ef-8099-4237-ab79-f2ed9dc9970f service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:19.816989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5f6ef-8099-4237-ab79-f2ed9dc9970f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:19.818645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-85c5f6ef-8099-4237-ab79-f2ed9dc9970f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:19.941822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:19.946594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5f6ef-8099-4237-ab79-f2ed9dc9970f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:19.948254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5f6ef-8099-4237-ab79-f2ed9dc9970f service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:19.969273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 679/1349] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:24.926992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad5f2c-fa5a-4c43-b154-38f6e21a2698 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:24.926992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad5f2c-fa5a-4c43-b154-38f6e21a2698 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:24.926992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ad5f2c-fa5a-4c43-b154-38f6e21a2698 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:24.927670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 671/1350] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:24.938991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02d301-297d-41e5-af4c-cda11c911774 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:24.938991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02d301-297d-41e5-af4c-cda11c911774 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:24.938991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c02d301-297d-41e5-af4c-cda11c911774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:25.033495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-0c02d301-297d-41e5-af4c-cda11c911774 None None] MFA Rules not processed for user `8572e4c550014fc4b1aea3ddf16f7d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:25.034892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0c02d301-297d-41e5-af4c-cda11c911774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:25.160712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 680/1351] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:10:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:29.300314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971daf-f30d-4abc-9a2a-9bbcd8d165d8 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:29.300891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971daf-f30d-4abc-9a2a-9bbcd8d165d8 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:29.300891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f971daf-f30d-4abc-9a2a-9bbcd8d165d8 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:29.302396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 672/1352] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:29.307620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e0131-4887-4f27-8d43-5e261693d159 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:29.308433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e0131-4887-4f27-8d43-5e261693d159 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:29.308982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e0131-4887-4f27-8d43-5e261693d159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:29.371236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:29.399378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fb4e0131-4887-4f27-8d43-5e261693d159 None None] MFA Rules not processed for user `8572e4c550014fc4b1aea3ddf16f7d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:29.400965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fb4e0131-4887-4f27-8d43-5e261693d159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:29.527452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 681/1353] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:10:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:29.572225 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=59 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:30.962552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b296-262d-46e1-979e-3e34233f8af3 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:30.963353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b296-262d-46e1-979e-3e34233f8af3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:30.963353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0b296-262d-46e1-979e-3e34233f8af3 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:30.964490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 673/1354] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:30.970269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a052bbf-b1fe-408c-9c7d-645e219a191c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:30.970715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a052bbf-b1fe-408c-9c7d-645e219a191c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:30.970995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a052bbf-b1fe-408c-9c7d-645e219a191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:31.046798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-6a052bbf-b1fe-408c-9c7d-645e219a191c None None] MFA Rules not processed for user `8572e4c550014fc4b1aea3ddf16f7d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:31.048016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6a052bbf-b1fe-408c-9c7d-645e219a191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:31.090393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:31.162024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 682/1355] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:10:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:10:34.498366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792de172-7943-4dca-87fe-7675a213689f None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:34.498870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792de172-7943-4dca-87fe-7675a213689f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:34.498870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792de172-7943-4dca-87fe-7675a213689f None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:34.500082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 674/1356] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:34.505328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54762-0764-47b7-95ab-88417fce80cb None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:34.505747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54762-0764-47b7-95ab-88417fce80cb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:34.505934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d54762-0764-47b7-95ab-88417fce80cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:34.579870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-73d54762-0764-47b7-95ab-88417fce80cb None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:34.581074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-73d54762-0764-47b7-95ab-88417fce80cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:34.682983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 683/1357] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:34.740503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a5c49-f359-443a-98ed-504822512271 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:34.741402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a5c49-f359-443a-98ed-504822512271 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:34.741854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5a5c49-f359-443a-98ed-504822512271 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:34.744217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 675/1358] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jul 21 04:10:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:34.754907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8783bc-c996-4197-a439-002aa40c1d33 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:34.755650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8783bc-c996-4197-a439-002aa40c1d33 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:34.756136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8783bc-c996-4197-a439-002aa40c1d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:34.772567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:34.839593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-7f8783bc-c996-4197-a439-002aa40c1d33 None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:34.840826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7f8783bc-c996-4197-a439-002aa40c1d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:34.963011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 684/1359] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jul 21 04:10:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:10:34.971996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a5c49-f359-443a-98ed-504822512271 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:34.973500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0c5a5c49-f359-443a-98ed-504822512271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:35.128344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5a5c49-f359-443a-98ed-504822512271 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:35.212877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:35.255732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b610798e-87e4-42b3-97f9-39daf62907b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:35.256415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610798e-87e4-42b3-97f9-39daf62907b9 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:35.256698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610798e-87e4-42b3-97f9-39daf62907b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:35.256977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b610798e-87e4-42b3-97f9-39daf62907b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:35.258820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b610798e-87e4-42b3-97f9-39daf62907b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:35.354016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610798e-87e4-42b3-97f9-39daf62907b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:35.355672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b610798e-87e4-42b3-97f9-39daf62907b9 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:35.379455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 676/1360] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:37.635403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098d36-7c77-437d-a48c-5dfd1e17bb4a None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:37.636376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098d36-7c77-437d-a48c-5dfd1e17bb4a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:37.636903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a098d36-7c77-437d-a48c-5dfd1e17bb4a None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:37.639391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 685/1361] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:37.644531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf56e27-1ae3-4db8-8282-9e3cc5ece34f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:37.645009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf56e27-1ae3-4db8-8282-9e3cc5ece34f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:37.645104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf56e27-1ae3-4db8-8282-9e3cc5ece34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:37.722511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-fdf56e27-1ae3-4db8-8282-9e3cc5ece34f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:37.724217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fdf56e27-1ae3-4db8-8282-9e3cc5ece34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:37.768167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:37.843006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 677/1362] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:37.887091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a098d36-7c77-437d-a48c-5dfd1e17bb4a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:37.888954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2a098d36-7c77-437d-a48c-5dfd1e17bb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:37.970524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:38.060596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a098d36-7c77-437d-a48c-5dfd1e17bb4a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:38.214277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9acfd9-b1a0-45eb-91b9-24906ac75975 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:38.214931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9acfd9-b1a0-45eb-91b9-24906ac75975 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:38.215242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9acfd9-b1a0-45eb-91b9-24906ac75975 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:38.216077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9acfd9-b1a0-45eb-91b9-24906ac75975 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:38.217747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ae9acfd9-b1a0-45eb-91b9-24906ac75975 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:38.242002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:38.318170 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9acfd9-b1a0-45eb-91b9-24906ac75975 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:38.320140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9acfd9-b1a0-45eb-91b9-24906ac75975 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:38.339494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 686/1363] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:40.731733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07fb39-3d23-460a-9e93-33d2a1d18231 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:40.732690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07fb39-3d23-460a-9e93-33d2a1d18231 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:40.732972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07fb39-3d23-460a-9e93-33d2a1d18231 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:40.734422 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 678/1364] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:40.740163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ab1fd-1991-4488-b274-9d1b0deedd02 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:40.740676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ab1fd-1991-4488-b274-9d1b0deedd02 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:40.740759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ab1fd-1991-4488-b274-9d1b0deedd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:40.833387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-786ab1fd-1991-4488-b274-9d1b0deedd02 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:40.834541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-786ab1fd-1991-4488-b274-9d1b0deedd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:40.966645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:40.973879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 687/1365] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:41.031438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3f810-95f9-4317-9e41-fa05f7c22027 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:41.031945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3f810-95f9-4317-9e41-fa05f7c22027 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:41.032437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3f810-95f9-4317-9e41-fa05f7c22027 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:41.033912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 679/1366] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jul 21 04:10:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:41.040623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90692-cf6f-4902-9d34-b11d3ec59408 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:41.040991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90692-cf6f-4902-9d34-b11d3ec59408 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:41.041348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f90692-cf6f-4902-9d34-b11d3ec59408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:41.133877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-31f90692-cf6f-4902-9d34-b11d3ec59408 None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:41.135064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-31f90692-cf6f-4902-9d34-b11d3ec59408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:41.305204 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 688/1367] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jul 21 04:10:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:41.314009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3f810-95f9-4317-9e41-fa05f7c22027 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:41.315576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8aa3f810-95f9-4317-9e41-fa05f7c22027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:41.508374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3f810-95f9-4317-9e41-fa05f7c22027 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:41.535995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:41.666774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35966f-b8b8-4e83-9465-3159b299df39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:41.667379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35966f-b8b8-4e83-9465-3159b299df39 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:41.667667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35966f-b8b8-4e83-9465-3159b299df39 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:41.667944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35966f-b8b8-4e83-9465-3159b299df39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:41.670330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5f35966f-b8b8-4e83-9465-3159b299df39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:41.773795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35966f-b8b8-4e83-9465-3159b299df39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:41.775552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35966f-b8b8-4e83-9465-3159b299df39 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:41.795595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 680/1368] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:42.682101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fead0ca-338a-4ff9-bf2a-6aa4fa13c23a None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:42.682659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fead0ca-338a-4ff9-bf2a-6aa4fa13c23a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:42.682659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fead0ca-338a-4ff9-bf2a-6aa4fa13c23a None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:42.687015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 689/1369] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:42.690508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96171-ee8f-447c-a061-fe8c7fa5ccf9 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:42.690795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96171-ee8f-447c-a061-fe8c7fa5ccf9 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:42.691104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd96171-ee8f-447c-a061-fe8c7fa5ccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:42.723698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:42.761248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1cd96171-ee8f-447c-a061-fe8c7fa5ccf9 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:42.762545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1cd96171-ee8f-447c-a061-fe8c7fa5ccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:42.866597 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 681/1370] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:43.214088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea36f3-cb1a-4331-95a5-b75d700e1f11 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:43.214088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea36f3-cb1a-4331-95a5-b75d700e1f11 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:43.214088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ea36f3-cb1a-4331-95a5-b75d700e1f11 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:43.216458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 690/1371] 10.222.0.48 () {54 vars in 964 bytes} [Thu Jul 21 04:10:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:43.221795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bdc34-341b-49d5-93d2-650f97c38ea0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:43.222091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bdc34-341b-49d5-93d2-650f97c38ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:43.222373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478bdc34-341b-49d5-93d2-650f97c38ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:43.300886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-478bdc34-341b-49d5-93d2-650f97c38ea0 None None] MFA Rules not processed for user `92407a5a276247e79d2abe41fee54c33`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:43.302948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-478bdc34-341b-49d5-93d2-650f97c38ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:43.353840 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:43.387439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 682/1372] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Jul 21 04:10:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:43.394843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea36f3-cb1a-4331-95a5-b75d700e1f11 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:43.396411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-63ea36f3-cb1a-4331-95a5-b75d700e1f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:43.451716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:43.510084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ea36f3-cb1a-4331-95a5-b75d700e1f11 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:43.589389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0d8a1-6a7f-43c4-899a-1d591ffce0b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:43.591110 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0d8a1-6a7f-43c4-899a-1d591ffce0b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:43.591394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0d8a1-6a7f-43c4-899a-1d591ffce0b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:43.591671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0d8a1-6a7f-43c4-899a-1d591ffce0b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:43.593346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-13f0d8a1-6a7f-43c4-899a-1d591ffce0b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:43.697587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:43.712210 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0d8a1-6a7f-43c4-899a-1d591ffce0b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:43.713581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f0d8a1-6a7f-43c4-899a-1d591ffce0b7 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:43.733068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 691/1373] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:43.946770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db272ddc-134c-49ba-8e30-bbf05abf82f6 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:43.947569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db272ddc-134c-49ba-8e30-bbf05abf82f6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:43.948036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db272ddc-134c-49ba-8e30-bbf05abf82f6 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:43.949477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 683/1374] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:43.954243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0569d5-df84-4661-af1b-5f9956f74806 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:43.954569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0569d5-df84-4661-af1b-5f9956f74806 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:43.954879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0569d5-df84-4661-af1b-5f9956f74806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:44.025802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2e0569d5-df84-4661-af1b-5f9956f74806 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:44.027007 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2e0569d5-df84-4661-af1b-5f9956f74806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:44.130610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 692/1375] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:44.175218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db272ddc-134c-49ba-8e30-bbf05abf82f6 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:44.176738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-db272ddc-134c-49ba-8e30-bbf05abf82f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:44.325339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db272ddc-134c-49ba-8e30-bbf05abf82f6 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:44.377684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:44.442254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99f7fe-7184-4885-923f-3c2965a868d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:44.442905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99f7fe-7184-4885-923f-3c2965a868d5 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:44.443215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99f7fe-7184-4885-923f-3c2965a868d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:44.443488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99f7fe-7184-4885-923f-3c2965a868d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:44.445114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8a99f7fe-7184-4885-923f-3c2965a868d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:44.534138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99f7fe-7184-4885-923f-3c2965a868d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:44.535812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99f7fe-7184-4885-923f-3c2965a868d5 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:44.554188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 684/1376] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:46.625199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da935b-1663-4007-8af3-56dfa0f3d45e None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:46.625649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da935b-1663-4007-8af3-56dfa0f3d45e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:46.625649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da935b-1663-4007-8af3-56dfa0f3d45e None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:46.627473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 693/1377] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:46.632708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6ab5-4eaa-40aa-b030-e87b518cc9d2 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:46.633126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6ab5-4eaa-40aa-b030-e87b518cc9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:46.633291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a6ab5-4eaa-40aa-b030-e87b518cc9d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:46.702975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d81a6ab5-4eaa-40aa-b030-e87b518cc9d2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:46.704278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d81a6ab5-4eaa-40aa-b030-e87b518cc9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:46.717570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:46.819688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 685/1378] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:46.864322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da935b-1663-4007-8af3-56dfa0f3d45e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:46.865833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-25da935b-1663-4007-8af3-56dfa0f3d45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:46.928356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:47.024787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da935b-1663-4007-8af3-56dfa0f3d45e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:47.148053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8ee58b-3b99-42da-a663-5dcafdb1caea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:47.148704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ee58b-3b99-42da-a663-5dcafdb1caea service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:47.148988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ee58b-3b99-42da-a663-5dcafdb1caea service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:47.149268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8ee58b-3b99-42da-a663-5dcafdb1caea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:47.150923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7a8ee58b-3b99-42da-a663-5dcafdb1caea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:47.186027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:47.275756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ee58b-3b99-42da-a663-5dcafdb1caea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:47.278491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8ee58b-3b99-42da-a663-5dcafdb1caea service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:47.302769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 694/1379] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:49.409415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5c567-a2ee-4f66-b12e-104bdaee742c None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:49.409964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5c567-a2ee-4f66-b12e-104bdaee742c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:49.409964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5c567-a2ee-4f66-b12e-104bdaee742c None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:49.411701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 686/1380] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:49.416667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a6f05-a082-4dea-961e-270190bd46a6 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:49.417065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a6f05-a082-4dea-961e-270190bd46a6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:49.417749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a6f05-a082-4dea-961e-270190bd46a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:49.486276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-5d2a6f05-a082-4dea-961e-270190bd46a6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:49.486991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-5d2a6f05-a082-4dea-961e-270190bd46a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:49.588579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:49.603111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 695/1381] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:49.641011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5c567-a2ee-4f66-b12e-104bdaee742c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:49.642911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e1f5c567-a2ee-4f66-b12e-104bdaee742c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:49.797106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:49.809509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5c567-a2ee-4f66-b12e-104bdaee742c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:49.940352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bab8e5-7b51-42ca-b396-e338f6f494a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:49.941326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab8e5-7b51-42ca-b396-e338f6f494a9 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:49.941829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab8e5-7b51-42ca-b396-e338f6f494a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:49.942306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bab8e5-7b51-42ca-b396-e338f6f494a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:49.944296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a4bab8e5-7b51-42ca-b396-e338f6f494a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:50.044017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bab8e5-7b51-42ca-b396-e338f6f494a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:50.046481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bab8e5-7b51-42ca-b396-e338f6f494a9 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:50.062694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:50.074915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 687/1382] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:52.154685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a566b9-0e54-419c-a70a-96ee8070203a None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:52.155271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a566b9-0e54-419c-a70a-96ee8070203a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:52.155271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a566b9-0e54-419c-a70a-96ee8070203a None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:52.156551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 696/1383] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:52.162332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb7c6f-0046-4e5d-bd93-6b91b8cf9dfc None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:52.162724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb7c6f-0046-4e5d-bd93-6b91b8cf9dfc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:52.163108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddb7c6f-0046-4e5d-bd93-6b91b8cf9dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:52.243545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-5ddb7c6f-0046-4e5d-bd93-6b91b8cf9dfc None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:52.244871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5ddb7c6f-0046-4e5d-bd93-6b91b8cf9dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:52.350775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 688/1384] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:52.396478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a566b9-0e54-419c-a70a-96ee8070203a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:52.398064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-54a566b9-0e54-419c-a70a-96ee8070203a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:52.585881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a566b9-0e54-419c-a70a-96ee8070203a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:52.664269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:52.713141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdac640-4a08-4b5f-bad8-fca9be390eec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:52.714553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdac640-4a08-4b5f-bad8-fca9be390eec service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:52.715114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdac640-4a08-4b5f-bad8-fca9be390eec service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:52.715498 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdac640-4a08-4b5f-bad8-fca9be390eec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:52.717489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3cdac640-4a08-4b5f-bad8-fca9be390eec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:52.816961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdac640-4a08-4b5f-bad8-fca9be390eec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:52.818823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdac640-4a08-4b5f-bad8-fca9be390eec service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:52.841345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 697/1385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:55.247284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390b12-0c4b-48b5-ac23-e3792ee576b4 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:55.247833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390b12-0c4b-48b5-ac23-e3792ee576b4 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:55.247989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23390b12-0c4b-48b5-ac23-e3792ee576b4 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:55.249902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 689/1386] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:55.255490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bd766-5ff0-4400-ac1d-f05bfadc6062 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:55.256049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bd766-5ff0-4400-ac1d-f05bfadc6062 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:55.256151 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bd766-5ff0-4400-ac1d-f05bfadc6062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:55.327592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-809bd766-5ff0-4400-ac1d-f05bfadc6062 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:55.328976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-809bd766-5ff0-4400-ac1d-f05bfadc6062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:55.365733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:55.439881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 698/1387] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:55.487035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390b12-0c4b-48b5-ac23-e3792ee576b4 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:55.489074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-23390b12-0c4b-48b5-ac23-e3792ee576b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:55.572282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:55.654659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23390b12-0c4b-48b5-ac23-e3792ee576b4 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:55.785418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075db124-3aab-4ebc-865a-cb7bccd8e36a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:55.786088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075db124-3aab-4ebc-865a-cb7bccd8e36a service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:55.786423 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075db124-3aab-4ebc-865a-cb7bccd8e36a service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:55.786753 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075db124-3aab-4ebc-865a-cb7bccd8e36a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:55.788733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-075db124-3aab-4ebc-865a-cb7bccd8e36a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:55.835239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:55.897621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075db124-3aab-4ebc-865a-cb7bccd8e36a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:55.899333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075db124-3aab-4ebc-865a-cb7bccd8e36a service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:55.918767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 690/1388] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:58.106866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac411829-6264-4ddc-8721-f7e825d30dc3 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:58.107508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac411829-6264-4ddc-8721-f7e825d30dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:58.107508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac411829-6264-4ddc-8721-f7e825d30dc3 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:58.108987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 699/1389] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:58.113924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997e8b-ce8a-4f49-9dbf-34ff9ae5b154 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:58.114372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997e8b-ce8a-4f49-9dbf-34ff9ae5b154 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:58.114487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c997e8b-ce8a-4f49-9dbf-34ff9ae5b154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:58.179627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1c997e8b-ce8a-4f49-9dbf-34ff9ae5b154 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:58.180852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1c997e8b-ce8a-4f49-9dbf-34ff9ae5b154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:58.279367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 691/1390] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:58.324140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac411829-6264-4ddc-8721-f7e825d30dc3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:58.325648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ac411829-6264-4ddc-8721-f7e825d30dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:58.476946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac411829-6264-4ddc-8721-f7e825d30dc3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:58.493593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:58.591515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50192d-c35b-4ba2-a090-3b8e88ba42aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:58.592164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50192d-c35b-4ba2-a090-3b8e88ba42aa service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:58.592445 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50192d-c35b-4ba2-a090-3b8e88ba42aa service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:58.592720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50192d-c35b-4ba2-a090-3b8e88ba42aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:58.594355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ef50192d-c35b-4ba2-a090-3b8e88ba42aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:58.686172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50192d-c35b-4ba2-a090-3b8e88ba42aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:58.688099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef50192d-c35b-4ba2-a090-3b8e88ba42aa service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:58.706603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 700/1391] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:10:58.845669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901cc1-9e7d-4965-a186-16aa9927776e None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:58.845956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901cc1-9e7d-4965-a186-16aa9927776e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:58.846238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b901cc1-9e7d-4965-a186-16aa9927776e None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:58.847710 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 692/1392] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:58.853550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036faa7-d028-4cc5-aa11-60dd68b2560f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:58.854021 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036faa7-d028-4cc5-aa11-60dd68b2560f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:58.854370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d036faa7-d028-4cc5-aa11-60dd68b2560f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:58.881043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:58.931587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d036faa7-d028-4cc5-aa11-60dd68b2560f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:58.933473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d036faa7-d028-4cc5-aa11-60dd68b2560f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:59.031099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 701/1393] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:59.087118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e73e4-c1f1-49ec-8055-5ecee6c51f0b None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:59.087408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e73e4-c1f1-49ec-8055-5ecee6c51f0b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:59.087685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e73e4-c1f1-49ec-8055-5ecee6c51f0b None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:59.089265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 693/1394] 10.222.0.48 () {54 vars in 966 bytes} [Thu Jul 21 04:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:10:59.094505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adf041-de81-4908-83e2-b2948e6718fc None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:59.094791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adf041-de81-4908-83e2-b2948e6718fc None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:59.095111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89adf041-de81-4908-83e2-b2948e6718fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:59.170661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-89adf041-de81-4908-83e2-b2948e6718fc None None] MFA Rules not processed for user `e210e10ee6b649399de11ac719a89718`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:10:59.171941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-89adf041-de81-4908-83e2-b2948e6718fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:59.215261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:59.252603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 702/1395] 10.222.0.48 () {58 vars in 1063 bytes} [Thu Jul 21 04:10:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:10:59.260138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e73e4-c1f1-49ec-8055-5ecee6c51f0b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:10:59.261681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-be7e73e4-c1f1-49ec-8055-5ecee6c51f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:59.275321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:59.366067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e73e4-c1f1-49ec-8055-5ecee6c51f0b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:10:59.440631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b4e407-eb15-4e8a-83fd-310e2ad23601 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210e10ee6b649399de11ac719a89718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:10:59.441283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4e407-eb15-4e8a-83fd-310e2ad23601 service glance] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:10:59.441564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4e407-eb15-4e8a-83fd-310e2ad23601 service glance] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:10:59.441839 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b4e407-eb15-4e8a-83fd-310e2ad23601 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:10:59.443509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-65b4e407-eb15-4e8a-83fd-310e2ad23601 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:10:59.512058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:10:59.554481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4e407-eb15-4e8a-83fd-310e2ad23601 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:10:59.555964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b4e407-eb15-4e8a-83fd-310e2ad23601 service glance] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:10:59.576132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 694/1396] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:11:00.279684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8dc18-3c39-4201-bd04-571af60a3660 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:00.280143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8dc18-3c39-4201-bd04-571af60a3660 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:00.280406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b8dc18-3c39-4201-bd04-571af60a3660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:00.345822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-23b8dc18-3c39-4201-bd04-571af60a3660 None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:00.346963 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-23b8dc18-3c39-4201-bd04-571af60a3660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:00.434519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 703/1397] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:11:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:00.481659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fc994-e29b-4d44-83cd-d5e069204294 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:00.482180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fc994-e29b-4d44-83cd-d5e069204294 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:00.482265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197fc994-e29b-4d44-83cd-d5e069204294 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:00.483665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 695/1398] 10.222.0.48 () {54 vars in 943 bytes} [Thu Jul 21 04:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:00.490077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946f058-7433-4105-a514-c9697011471a None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:00.490433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946f058-7433-4105-a514-c9697011471a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:00.490776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946f058-7433-4105-a514-c9697011471a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:00.558632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:00.567226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b946f058-7433-4105-a514-c9697011471a None None] MFA Rules not processed for user `4bfb2a63f46a4a419da65805253ef7ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:00.568428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b946f058-7433-4105-a514-c9697011471a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:00.682969 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 704/1399] 10.222.0.48 () {58 vars in 1040 bytes} [Thu Jul 21 04:11:00 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:00.692349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fc994-e29b-4d44-83cd-d5e069204294 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:00.693879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-197fc994-e29b-4d44-83cd-d5e069204294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:00.800993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ba100-352e-49b8-bcce-c0810314d43d None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:00.801279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ba100-352e-49b8-bcce-c0810314d43d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:00.801558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ba100-352e-49b8-bcce-c0810314d43d None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:00.803009 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 705/1400] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:11:00.808715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bd40b-0d74-48dc-aa6d-a8574b25bf8c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:00.809002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bd40b-0d74-48dc-aa6d-a8574b25bf8c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:00.809278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45bd40b-0d74-48dc-aa6d-a8574b25bf8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:00.842602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197fc994-e29b-4d44-83cd-d5e069204294 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:00.875502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a45bd40b-0d74-48dc-aa6d-a8574b25bf8c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:00.876632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a45bd40b-0d74-48dc-aa6d-a8574b25bf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:00.881558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:00.938767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:00.952906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ff4ac2-e215-4faa-b433-7fa9efae3bef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:00.953557 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff4ac2-e215-4faa-b433-7fa9efae3bef service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:00.953842 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff4ac2-e215-4faa-b433-7fa9efae3bef service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:00.954125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ff4ac2-e215-4faa-b433-7fa9efae3bef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:00.955851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-68ff4ac2-e215-4faa-b433-7fa9efae3bef service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:00.977158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 706/1401] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:01.021945 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bd40b-0d74-48dc-aa6d-a8574b25bf8c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:01.023186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a45bd40b-0d74-48dc-aa6d-a8574b25bf8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:01.040905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff4ac2-e215-4faa-b433-7fa9efae3bef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:01.043112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ff4ac2-e215-4faa-b433-7fa9efae3bef service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:01.051335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 696/1402] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:11:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:11:01.153324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45bd40b-0d74-48dc-aa6d-a8574b25bf8c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:01.245142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:01.295410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e6a349-188c-45f9-8f1a-26f2e3ef940e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:01.296068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6a349-188c-45f9-8f1a-26f2e3ef940e service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:01.296472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6a349-188c-45f9-8f1a-26f2e3ef940e service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:01.296760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e6a349-188c-45f9-8f1a-26f2e3ef940e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:01.298485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f1e6a349-188c-45f9-8f1a-26f2e3ef940e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:01.396497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6a349-188c-45f9-8f1a-26f2e3ef940e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:01.398390 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e6a349-188c-45f9-8f1a-26f2e3ef940e service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:01.418315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 707/1403] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:11:03.617897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53b3c6-bd43-4ddf-9089-145c178a7818 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:03.618486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53b3c6-bd43-4ddf-9089-145c178a7818 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:03.618486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53b3c6-bd43-4ddf-9089-145c178a7818 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:03.620660 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 697/1404] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:11:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:03.625814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6643-da96-4c97-a4ba-11d57cb890c7 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:03.626265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6643-da96-4c97-a4ba-11d57cb890c7 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:03.626449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc6643-da96-4c97-a4ba-11d57cb890c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:03.694129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ebfc6643-da96-4c97-a4ba-11d57cb890c7 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:03.695362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ebfc6643-da96-4c97-a4ba-11d57cb890c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:03.737725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:03.810449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 708/1405] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:03.856513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53b3c6-bd43-4ddf-9089-145c178a7818 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:03.858052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bc53b3c6-bd43-4ddf-9089-145c178a7818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:03.944063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:04.029106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53b3c6-bd43-4ddf-9089-145c178a7818 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:04.153488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b561a-b7e1-4966-a549-261ae453d8b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:04.154060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b561a-b7e1-4966-a549-261ae453d8b5 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:04.154347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b561a-b7e1-4966-a549-261ae453d8b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:04.154627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b561a-b7e1-4966-a549-261ae453d8b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:04.156318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2d9b561a-b7e1-4966-a549-261ae453d8b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:04.193267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:04.264276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b561a-b7e1-4966-a549-261ae453d8b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:04.265971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b561a-b7e1-4966-a549-261ae453d8b5 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:04.285163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 698/1406] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:06.393170 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f38e2-0523-4b61-8e91-12c982b09e32 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:06.393724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f38e2-0523-4b61-8e91-12c982b09e32 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:06.393724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7f38e2-0523-4b61-8e91-12c982b09e32 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:06.398998 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 709/1407] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:11:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:06.401115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d9886-481b-4382-a097-7f1c7e7fba5f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:06.401518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d9886-481b-4382-a097-7f1c7e7fba5f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:06.401626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677d9886-481b-4382-a097-7f1c7e7fba5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:06.473636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-677d9886-481b-4382-a097-7f1c7e7fba5f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:06.474970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-677d9886-481b-4382-a097-7f1c7e7fba5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:06.594254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 699/1408] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:11:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:06.640374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f38e2-0523-4b61-8e91-12c982b09e32 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:06.641940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3d7f38e2-0523-4b61-8e91-12c982b09e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:06.803051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7f38e2-0523-4b61-8e91-12c982b09e32 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:06.825686 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:06.940352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e1da5-6fca-4244-9db0-a591dd9b2bcd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:06.941134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e1da5-6fca-4244-9db0-a591dd9b2bcd service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:06.941435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e1da5-6fca-4244-9db0-a591dd9b2bcd service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:06.941711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e1da5-6fca-4244-9db0-a591dd9b2bcd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:06.943587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d48e1da5-6fca-4244-9db0-a591dd9b2bcd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:07.052249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e1da5-6fca-4244-9db0-a591dd9b2bcd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:07.053882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48e1da5-6fca-4244-9db0-a591dd9b2bcd service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:07.075522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 710/1409] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:16.591417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:17.071659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=88 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:23.256087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342473a-8307-449e-b9c3-ae1728894df0 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:23.256662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342473a-8307-449e-b9c3-ae1728894df0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:23.256662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342473a-8307-449e-b9c3-ae1728894df0 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:23.258012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 700/1410] 10.222.0.48 () {54 vars in 918 bytes} [Thu Jul 21 04:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:23.263764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915d86f-08ef-4cf8-a2e1-7efaed4d8829 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:23.264174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915d86f-08ef-4cf8-a2e1-7efaed4d8829 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:23.264322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915d86f-08ef-4cf8-a2e1-7efaed4d8829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:23.339041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-3915d86f-08ef-4cf8-a2e1-7efaed4d8829 None None] MFA Rules not processed for user `8572e4c550014fc4b1aea3ddf16f7d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:23.340203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3915d86f-08ef-4cf8-a2e1-7efaed4d8829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:23.443285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 711/1411] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jul 21 04:11:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:23.458221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e3da-c0c8-41ce-9c51-5606d10e0e48 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:23.458513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e3da-c0c8-41ce-9c51-5606d10e0e48 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:23.458795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4e3da-c0c8-41ce-9c51-5606d10e0e48 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:23.460221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 701/1412] 10.222.0.48 () {54 vars in 918 bytes} [Thu Jul 21 04:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:23.464734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040969-37db-4cce-972c-b858e1a9b189 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:23.465022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040969-37db-4cce-972c-b858e1a9b189 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:23.465302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32040969-37db-4cce-972c-b858e1a9b189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:23.536706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:23.540886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-32040969-37db-4cce-972c-b858e1a9b189 None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:23.542732 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-32040969-37db-4cce-972c-b858e1a9b189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:23.660277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 712/1413] 10.222.0.48 () {58 vars in 1015 bytes} [Thu Jul 21 04:11:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:26.150126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3546eef-4dc4-4429-9cb2-2036a324920f None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:26.150642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3546eef-4dc4-4429-9cb2-2036a324920f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:26.150642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3546eef-4dc4-4429-9cb2-2036a324920f None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:26.152019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:26.157351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5ec7a-0a6f-4d18-8bf8-a42df2a0e9ea None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:26.157777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5ec7a-0a6f-4d18-8bf8-a42df2a0e9ea None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:26.157905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f5ec7a-0a6f-4d18-8bf8-a42df2a0e9ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:26.223008 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-85f5ec7a-0a6f-4d18-8bf8-a42df2a0e9ea None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:26.224212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-85f5ec7a-0a6f-4d18-8bf8-a42df2a0e9ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:26.278400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:26.320637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:11:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:26.363690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3546eef-4dc4-4429-9cb2-2036a324920f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:26.365273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e3546eef-4dc4-4429-9cb2-2036a324920f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:26.511583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3546eef-4dc4-4429-9cb2-2036a324920f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:26.587659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:26.631345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e62ea-a8cc-451c-9e94-b4a2936c2e50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:26.631990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e62ea-a8cc-451c-9e94-b4a2936c2e50 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:26.632271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e62ea-a8cc-451c-9e94-b4a2936c2e50 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:26.632543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e62ea-a8cc-451c-9e94-b4a2936c2e50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:26.634177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bb8e62ea-a8cc-451c-9e94-b4a2936c2e50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:26.721989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e62ea-a8cc-451c-9e94-b4a2936c2e50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:26.723626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e62ea-a8cc-451c-9e94-b4a2936c2e50 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:26.742181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 703/1416] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:27.650128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4b4c-ebf5-4db1-a5c0-b4babab43a9e None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:27.650718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4b4c-ebf5-4db1-a5c0-b4babab43a9e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:27.650718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4b4c-ebf5-4db1-a5c0-b4babab43a9e None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:27.652103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:27.656967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c72ee0-ae03-45e1-856a-f25ea90202d2 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:27.657401 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c72ee0-ae03-45e1-856a-f25ea90202d2 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:27.657511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c72ee0-ae03-45e1-856a-f25ea90202d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:27.733635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-79c72ee0-ae03-45e1-856a-f25ea90202d2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:27.734830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-79c72ee0-ae03-45e1-856a-f25ea90202d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:27.761757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:27.831266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:27.980537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4b4c-ebf5-4db1-a5c0-b4babab43a9e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:27.982053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ac4b4b4c-ebf5-4db1-a5c0-b4babab43a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:28.126638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4b4c-ebf5-4db1-a5c0-b4babab43a9e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:28.166796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:28.238825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5552ea-428d-4903-a927-a8e8ea532d2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:28.239496 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5552ea-428d-4903-a927-a8e8ea532d2a service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:28.239775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5552ea-428d-4903-a927-a8e8ea532d2a service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:28.240046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5552ea-428d-4903-a927-a8e8ea532d2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:28.241670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ed5552ea-428d-4903-a927-a8e8ea532d2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:28.329962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5552ea-428d-4903-a927-a8e8ea532d2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:28.331596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5552ea-428d-4903-a927-a8e8ea532d2a service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:28.350284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 715/1419] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:29.228866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470007f1-6e05-4827-953e-5134116afce1 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:29.229383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470007f1-6e05-4827-953e-5134116afce1 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:29.229505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470007f1-6e05-4827-953e-5134116afce1 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:29.230796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:29.235649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479b6e-140a-4a94-90ab-05b7e521c935 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:29.236069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479b6e-140a-4a94-90ab-05b7e521c935 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:29.236201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55479b6e-140a-4a94-90ab-05b7e521c935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:29.289763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:29.311044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-55479b6e-140a-4a94-90ab-05b7e521c935 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:29.312242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-55479b6e-140a-4a94-90ab-05b7e521c935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:29.407309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:29.560759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470007f1-6e05-4827-953e-5134116afce1 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:29.562222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-470007f1-6e05-4827-953e-5134116afce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:29.704954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470007f1-6e05-4827-953e-5134116afce1 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:29.716925 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:29.815252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc2abb-e734-4067-a1cd-da29187d7113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:29.815813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2abb-e734-4067-a1cd-da29187d7113 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:29.816094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2abb-e734-4067-a1cd-da29187d7113 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:29.816367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc2abb-e734-4067-a1cd-da29187d7113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:29.817983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-28cc2abb-e734-4067-a1cd-da29187d7113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:29.904483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc2abb-e734-4067-a1cd-da29187d7113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:29.906095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc2abb-e734-4067-a1cd-da29187d7113 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:29.924243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 706/1422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:30.782269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86afead-49e1-47a3-9244-bec3eb0c989a None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:30.782845 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86afead-49e1-47a3-9244-bec3eb0c989a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:30.782845 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86afead-49e1-47a3-9244-bec3eb0c989a None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:30.784278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:30.789270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02a7fe-c6b2-49a7-acf2-ee1e19a883bd None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:30.790346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02a7fe-c6b2-49a7-acf2-ee1e19a883bd None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:30.790346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b02a7fe-c6b2-49a7-acf2-ee1e19a883bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:30.809481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:30.865909 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-4b02a7fe-c6b2-49a7-acf2-ee1e19a883bd None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:30.867126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4b02a7fe-c6b2-49a7-acf2-ee1e19a883bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:30.965046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:31.113553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86afead-49e1-47a3-9244-bec3eb0c989a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:31.115101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f86afead-49e1-47a3-9244-bec3eb0c989a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:31.224100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:31.260458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86afead-49e1-47a3-9244-bec3eb0c989a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:31.370284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2751afb-49e0-4c31-b7f7-a905af134567 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:31.370847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2751afb-49e0-4c31-b7f7-a905af134567 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:31.371158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2751afb-49e0-4c31-b7f7-a905af134567 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:31.371442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2751afb-49e0-4c31-b7f7-a905af134567 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:31.373066 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f2751afb-49e0-4c31-b7f7-a905af134567 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:31.447242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:31.461109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2751afb-49e0-4c31-b7f7-a905af134567 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:31.463113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2751afb-49e0-4c31-b7f7-a905af134567 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:31.481280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 718/1425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:32.335936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cd4f3-68d3-4738-9cef-5bf72f5d08ac None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:32.336927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cd4f3-68d3-4738-9cef-5bf72f5d08ac None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:32.336927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1cd4f3-68d3-4738-9cef-5bf72f5d08ac None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:32.337947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:32.342860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e70cfb-7482-434a-8684-efaf54298899 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:32.343306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e70cfb-7482-434a-8684-efaf54298899 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:32.343502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e70cfb-7482-434a-8684-efaf54298899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:32.418517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-26e70cfb-7482-434a-8684-efaf54298899 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:32.419778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-26e70cfb-7482-434a-8684-efaf54298899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:32.515487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:32.662919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cd4f3-68d3-4738-9cef-5bf72f5d08ac None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:32.665100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1d1cd4f3-68d3-4738-9cef-5bf72f5d08ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:32.747737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:32.808589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1cd4f3-68d3-4738-9cef-5bf72f5d08ac None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:32.923524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d83903-8284-4585-8f79-e8b51cb15e8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:32.924170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d83903-8284-4585-8f79-e8b51cb15e8a service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:32.924449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d83903-8284-4585-8f79-e8b51cb15e8a service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:32.924722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d83903-8284-4585-8f79-e8b51cb15e8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:32.926360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-23d83903-8284-4585-8f79-e8b51cb15e8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:32.974398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:33.015638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d83903-8284-4585-8f79-e8b51cb15e8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:33.017258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d83903-8284-4585-8f79-e8b51cb15e8a service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:33.035685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 709/1428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:33.844925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae770d0-807d-4f00-99ed-6a0508345793 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:33.845469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae770d0-807d-4f00-99ed-6a0508345793 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:33.845469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae770d0-807d-4f00-99ed-6a0508345793 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:33.846889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:33.851824 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04237-db25-4ebb-be0e-7c53e72f3baa None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:33.852761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04237-db25-4ebb-be0e-7c53e72f3baa None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:33.853013 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04237-db25-4ebb-be0e-7c53e72f3baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:33.928642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-97f04237-db25-4ebb-be0e-7c53e72f3baa None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:33.929854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-97f04237-db25-4ebb-be0e-7c53e72f3baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:34.026351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:34.176153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae770d0-807d-4f00-99ed-6a0508345793 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:34.177849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7ae770d0-807d-4f00-99ed-6a0508345793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:34.228156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:34.325688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae770d0-807d-4f00-99ed-6a0508345793 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:34.439427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcee4b4-c1a5-48d7-aede-8c22f38c880d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:34.439976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcee4b4-c1a5-48d7-aede-8c22f38c880d service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:34.440264 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcee4b4-c1a5-48d7-aede-8c22f38c880d service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:34.440539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcee4b4-c1a5-48d7-aede-8c22f38c880d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:34.442188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-adcee4b4-c1a5-48d7-aede-8c22f38c880d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:34.450013 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:34.534193 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcee4b4-c1a5-48d7-aede-8c22f38c880d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:34.535840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcee4b4-c1a5-48d7-aede-8c22f38c880d service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:34.553543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 721/1431] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:35.361762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6f6f-3057-4804-8a07-1e50a29c771e None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:35.362314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6f6f-3057-4804-8a07-1e50a29c771e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:35.362314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e6f6f-3057-4804-8a07-1e50a29c771e None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:35.363725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:35.369066 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a3c0a-4513-4ccf-9fb0-56ce9ea259f1 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:35.369479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a3c0a-4513-4ccf-9fb0-56ce9ea259f1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:35.369627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568a3c0a-4513-4ccf-9fb0-56ce9ea259f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:35.444028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-568a3c0a-4513-4ccf-9fb0-56ce9ea259f1 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:35.445147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-568a3c0a-4513-4ccf-9fb0-56ce9ea259f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:35.511744 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:35.541602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:35.690032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6f6f-3057-4804-8a07-1e50a29c771e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:35.691651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7e1e6f6f-3057-4804-8a07-1e50a29c771e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:35.709541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:35.838782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e6f6f-3057-4804-8a07-1e50a29c771e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:35.924096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:35.950151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b1552-ef54-4b7b-bb3f-d35b5279df33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:35.950776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b1552-ef54-4b7b-bb3f-d35b5279df33 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:35.951090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b1552-ef54-4b7b-bb3f-d35b5279df33 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:35.951364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b1552-ef54-4b7b-bb3f-d35b5279df33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:35.952998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c31b1552-ef54-4b7b-bb3f-d35b5279df33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:36.039444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b1552-ef54-4b7b-bb3f-d35b5279df33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:36.041036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b1552-ef54-4b7b-bb3f-d35b5279df33 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:36.058583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 712/1434] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:36.861343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d515b-e7bb-41fd-87e0-4ff5b0cca0c8 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:36.861922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d515b-e7bb-41fd-87e0-4ff5b0cca0c8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:36.861922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0d515b-e7bb-41fd-87e0-4ff5b0cca0c8 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:36.863331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:36.868223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc067e86-9c3d-4b72-b182-319b2d62e412 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:36.869238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc067e86-9c3d-4b72-b182-319b2d62e412 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:36.869360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc067e86-9c3d-4b72-b182-319b2d62e412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:36.946751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-dc067e86-9c3d-4b72-b182-319b2d62e412 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:36.948652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-dc067e86-9c3d-4b72-b182-319b2d62e412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:36.991788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:37.048231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:37.199635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d515b-e7bb-41fd-87e0-4ff5b0cca0c8 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:37.201213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ea0d515b-e7bb-41fd-87e0-4ff5b0cca0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:37.346073 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0d515b-e7bb-41fd-87e0-4ff5b0cca0c8 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:37.398667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:37.457181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7af7de-40bb-4e9e-afd5-7c1daf54964b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:37.457773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7af7de-40bb-4e9e-afd5-7c1daf54964b service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:37.458055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7af7de-40bb-4e9e-afd5-7c1daf54964b service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:37.458330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7af7de-40bb-4e9e-afd5-7c1daf54964b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:37.460013 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0d7af7de-40bb-4e9e-afd5-7c1daf54964b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:37.548216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7af7de-40bb-4e9e-afd5-7c1daf54964b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:37.549835 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7af7de-40bb-4e9e-afd5-7c1daf54964b service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:37.567497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 724/1437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:38.394047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac88ccb-e4aa-4aae-9b18-a9177f8ebb8b None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:38.394584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac88ccb-e4aa-4aae-9b18-a9177f8ebb8b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:38.394703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac88ccb-e4aa-4aae-9b18-a9177f8ebb8b None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:38.396039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:38.401360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c254b2a-1a26-4810-a416-30a3be903860 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:38.401771 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c254b2a-1a26-4810-a416-30a3be903860 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:38.401924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c254b2a-1a26-4810-a416-30a3be903860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:38.477344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-9c254b2a-1a26-4810-a416-30a3be903860 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:38.479068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9c254b2a-1a26-4810-a416-30a3be903860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:38.481030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:38.576126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:38.726323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac88ccb-e4aa-4aae-9b18-a9177f8ebb8b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:38.727945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4ac88ccb-e4aa-4aae-9b18-a9177f8ebb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:38.873061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac88ccb-e4aa-4aae-9b18-a9177f8ebb8b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:38.902373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:38.989576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cec4c-9e20-4cc1-ae68-7217e73b6acd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:38.990147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cec4c-9e20-4cc1-ae68-7217e73b6acd service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:38.990430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cec4c-9e20-4cc1-ae68-7217e73b6acd service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:38.990706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cec4c-9e20-4cc1-ae68-7217e73b6acd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:38.992385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b44cec4c-9e20-4cc1-ae68-7217e73b6acd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:39.080980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cec4c-9e20-4cc1-ae68-7217e73b6acd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:39.082627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cec4c-9e20-4cc1-ae68-7217e73b6acd service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:39.100974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 715/1440] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:41.036739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54542a80-4803-4f41-bee4-50397653e8ab None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:41.037330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54542a80-4803-4f41-bee4-50397653e8ab None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:41.037330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54542a80-4803-4f41-bee4-50397653e8ab None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:41.038819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:41.045538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac512d-75be-48ac-a7b8-95e83dab7e54 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:41.046077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac512d-75be-48ac-a7b8-95e83dab7e54 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:41.046172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac512d-75be-48ac-a7b8-95e83dab7e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:41.087178 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:41.116247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-94ac512d-75be-48ac-a7b8-95e83dab7e54 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:41.117474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-94ac512d-75be-48ac-a7b8-95e83dab7e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:41.226890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:41.270719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54542a80-4803-4f41-bee4-50397653e8ab None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:41.272288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-54542a80-4803-4f41-bee4-50397653e8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:41.385572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54542a80-4803-4f41-bee4-50397653e8ab None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:41.423497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:41.472687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f4dc9a-1e54-413d-9978-bb90014ed91a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:41.473348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4dc9a-1e54-413d-9978-bb90014ed91a service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:41.473628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4dc9a-1e54-413d-9978-bb90014ed91a service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:41.473913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f4dc9a-1e54-413d-9978-bb90014ed91a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:41.475631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-24f4dc9a-1e54-413d-9978-bb90014ed91a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:41.589719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4dc9a-1e54-413d-9978-bb90014ed91a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:41.591205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f4dc9a-1e54-413d-9978-bb90014ed91a service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:41.609138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 727/1443] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:43.815939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a8ccf-3614-4663-8367-592d5381f70c None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:43.816548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a8ccf-3614-4663-8367-592d5381f70c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:43.816548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a8ccf-3614-4663-8367-592d5381f70c None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:43.817896 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:43.824161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a735e5-b90d-447c-a664-1be3a20215eb None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:43.824601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a735e5-b90d-447c-a664-1be3a20215eb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:43.824733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a735e5-b90d-447c-a664-1be3a20215eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:43.889344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c9a735e5-b90d-447c-a664-1be3a20215eb None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:43.890896 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c9a735e5-b90d-447c-a664-1be3a20215eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:43.904701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:43.989858 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:44.029109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a8ccf-3614-4663-8367-592d5381f70c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:44.030688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9c7a8ccf-3614-4663-8367-592d5381f70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:44.134010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a8ccf-3614-4663-8367-592d5381f70c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:44.147627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:44.214558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eba7d3a-15ce-458c-8011-1ba8a40d3351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:44.215861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7d3a-15ce-458c-8011-1ba8a40d3351 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:44.216154 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7d3a-15ce-458c-8011-1ba8a40d3351 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:44.216431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba7d3a-15ce-458c-8011-1ba8a40d3351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:44.218773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2eba7d3a-15ce-458c-8011-1ba8a40d3351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:44.328929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba7d3a-15ce-458c-8011-1ba8a40d3351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:44.330368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eba7d3a-15ce-458c-8011-1ba8a40d3351 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:44.348102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 718/1446] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:46.674200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3cd5a-e7ac-4e15-ab4c-02058cd42dbd None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:46.674762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3cd5a-e7ac-4e15-ab4c-02058cd42dbd None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:46.674762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3cd5a-e7ac-4e15-ab4c-02058cd42dbd None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:46.676191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:46.682507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc606e-1a52-4f4c-ac82-3eb65341a8b0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:46.682947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc606e-1a52-4f4c-ac82-3eb65341a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:46.683089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc606e-1a52-4f4c-ac82-3eb65341a8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:46.729088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:46.747930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-82bc606e-1a52-4f4c-ac82-3eb65341a8b0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:46.749121 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-82bc606e-1a52-4f4c-ac82-3eb65341a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:46.842716 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:11:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:11:46.881863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3cd5a-e7ac-4e15-ab4c-02058cd42dbd None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:46.883467 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-70a3cd5a-e7ac-4e15-ab4c-02058cd42dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:46.987709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a3cd5a-e7ac-4e15-ab4c-02058cd42dbd None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:47.028157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:47.062193 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2088ad5-c122-4fee-a9a5-0d4166459b0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:47.062839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2088ad5-c122-4fee-a9a5-0d4166459b0b service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:47.063155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2088ad5-c122-4fee-a9a5-0d4166459b0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:47.063427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2088ad5-c122-4fee-a9a5-0d4166459b0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:47.065060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e2088ad5-c122-4fee-a9a5-0d4166459b0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:47.172738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2088ad5-c122-4fee-a9a5-0d4166459b0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:47.174236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2088ad5-c122-4fee-a9a5-0d4166459b0b service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:47.192482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 730/1449] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:49.358108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335fde-4f9e-4e5c-8200-2d2be8e96bad None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:49.358677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335fde-4f9e-4e5c-8200-2d2be8e96bad None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:49.358677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a335fde-4f9e-4e5c-8200-2d2be8e96bad None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:49.360234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:11:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:49.365473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3de94-edeb-45f3-9652-121a654db2b8 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:49.365915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3de94-edeb-45f3-9652-121a654db2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:49.366031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3de94-edeb-45f3-9652-121a654db2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:49.430675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-47d3de94-edeb-45f3-9652-121a654db2b8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:49.432104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-47d3de94-edeb-45f3-9652-121a654db2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:49.452900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:49.530291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:49.569885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335fde-4f9e-4e5c-8200-2d2be8e96bad None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:49.571778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6a335fde-4f9e-4e5c-8200-2d2be8e96bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:49.676267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a335fde-4f9e-4e5c-8200-2d2be8e96bad None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:49.696544 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:49.749937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8946531-fb27-4118-8461-7dc1b10fce05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:49.750505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946531-fb27-4118-8461-7dc1b10fce05 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:49.750785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946531-fb27-4118-8461-7dc1b10fce05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:49.751093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8946531-fb27-4118-8461-7dc1b10fce05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:49.752723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e8946531-fb27-4118-8461-7dc1b10fce05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:49.862150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8946531-fb27-4118-8461-7dc1b10fce05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:49.863621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8946531-fb27-4118-8461-7dc1b10fce05 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:49.881621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 721/1452] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:52.091502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831439-a0e7-4520-ae40-f8da2790f3ac None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:52.092059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831439-a0e7-4520-ae40-f8da2790f3ac None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:52.092059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58831439-a0e7-4520-ae40-f8da2790f3ac None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:52.093451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:52.098666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f32eb2-bed0-4547-b0d6-1382442af342 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:52.099113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f32eb2-bed0-4547-b0d6-1382442af342 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:52.099252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f32eb2-bed0-4547-b0d6-1382442af342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:52.168974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:52.171618 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-31f32eb2-bed0-4547-b0d6-1382442af342 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:52.173362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-31f32eb2-bed0-4547-b0d6-1382442af342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:52.273074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:52.312271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58831439-a0e7-4520-ae40-f8da2790f3ac None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:52.313851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-58831439-a0e7-4520-ae40-f8da2790f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:52.416731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58831439-a0e7-4520-ae40-f8da2790f3ac None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:52.465807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:52.490482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c44402-b4f7-426e-bb32-c816c1ba63f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:52.491156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c44402-b4f7-426e-bb32-c816c1ba63f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:52.491440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c44402-b4f7-426e-bb32-c816c1ba63f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:52.491715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c44402-b4f7-426e-bb32-c816c1ba63f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:52.493368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f8c44402-b4f7-426e-bb32-c816c1ba63f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:52.603066 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c44402-b4f7-426e-bb32-c816c1ba63f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:52.604649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c44402-b4f7-426e-bb32-c816c1ba63f5 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:52.622925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 733/1455] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:54.774406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322a9d9-623a-4b4d-b82e-36848cae5e46 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:54.774985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322a9d9-623a-4b4d-b82e-36848cae5e46 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:54.775117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322a9d9-623a-4b4d-b82e-36848cae5e46 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:54.776576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:54.782126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060627f4-d08e-49a9-ac8d-9a866cb20eea None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:54.782521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060627f4-d08e-49a9-ac8d-9a866cb20eea None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:54.782691 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060627f4-d08e-49a9-ac8d-9a866cb20eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:54.846968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-060627f4-d08e-49a9-ac8d-9a866cb20eea None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:54.848151 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-060627f4-d08e-49a9-ac8d-9a866cb20eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:54.876795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:54.944228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:54.983620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322a9d9-623a-4b4d-b82e-36848cae5e46 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:54.985174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3322a9d9-623a-4b4d-b82e-36848cae5e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:55.090625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322a9d9-623a-4b4d-b82e-36848cae5e46 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:55.119826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:55.167267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854e55eb-b8d9-47c0-b9aa-6f34ca5dcdec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:55.167922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e55eb-b8d9-47c0-b9aa-6f34ca5dcdec service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:55.168300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e55eb-b8d9-47c0-b9aa-6f34ca5dcdec service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:55.168496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e55eb-b8d9-47c0-b9aa-6f34ca5dcdec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:55.170470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-854e55eb-b8d9-47c0-b9aa-6f34ca5dcdec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:55.281791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e55eb-b8d9-47c0-b9aa-6f34ca5dcdec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:55.283284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854e55eb-b8d9-47c0-b9aa-6f34ca5dcdec service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:55.301754 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 724/1458] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:11:57.410483 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3df48-210f-47cd-b1a9-bf1566548fb0 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:57.411025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3df48-210f-47cd-b1a9-bf1566548fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:57.411152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3df48-210f-47cd-b1a9-bf1566548fb0 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:57.412449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:57.418267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28518d4f-b162-47fa-a003-781aea454e9d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:57.418695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28518d4f-b162-47fa-a003-781aea454e9d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:57.418831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28518d4f-b162-47fa-a003-781aea454e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:57.483624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-28518d4f-b162-47fa-a003-781aea454e9d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:11:57.484765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-28518d4f-b162-47fa-a003-781aea454e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:57.492894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:57.581865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:11:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:11:57.620011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3df48-210f-47cd-b1a9-bf1566548fb0 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:11:57.621555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a9e3df48-210f-47cd-b1a9-bf1566548fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:57.722964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3df48-210f-47cd-b1a9-bf1566548fb0 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:11:57.778467 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:11:57.796978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9f4e4-1b5b-426c-ab06-a42f7ae27024 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:11:57.797617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9f4e4-1b5b-426c-ab06-a42f7ae27024 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:57.797896 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9f4e4-1b5b-426c-ab06-a42f7ae27024 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:57.798169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9f4e4-1b5b-426c-ab06-a42f7ae27024 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:57.799832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-24c9f4e4-1b5b-426c-ab06-a42f7ae27024 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:11:57.909316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9f4e4-1b5b-426c-ab06-a42f7ae27024 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:11:57.910771 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9f4e4-1b5b-426c-ab06-a42f7ae27024 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:11:57.928685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 736/1461] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:11:59.989010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bf38c-e021-4a2f-ad16-2eba5743c8eb None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:59.989504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bf38c-e021-4a2f-ad16-2eba5743c8eb None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:59.989618 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812bf38c-e021-4a2f-ad16-2eba5743c8eb None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:11:59.990970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:11:59.996310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c885311-3cd4-4e65-a7c3-54825f2fcc03 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:11:59.996762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c885311-3cd4-4e65-a7c3-54825f2fcc03 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:11:59.996883 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c885311-3cd4-4e65-a7c3-54825f2fcc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:00.060694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-9c885311-3cd4-4e65-a7c3-54825f2fcc03 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:00.061891 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9c885311-3cd4-4e65-a7c3-54825f2fcc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:00.099678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:00.159994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:00.198250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bf38c-e021-4a2f-ad16-2eba5743c8eb None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:00.199873 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-812bf38c-e021-4a2f-ad16-2eba5743c8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:00.304403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812bf38c-e021-4a2f-ad16-2eba5743c8eb None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:00.342917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:00.377998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd370c83-0433-4cb7-b16e-997af2880ce6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:00.378650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd370c83-0433-4cb7-b16e-997af2880ce6 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:00.378939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd370c83-0433-4cb7-b16e-997af2880ce6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:00.379248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd370c83-0433-4cb7-b16e-997af2880ce6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:00.380895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bd370c83-0433-4cb7-b16e-997af2880ce6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:00.495740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd370c83-0433-4cb7-b16e-997af2880ce6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:00.497104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd370c83-0433-4cb7-b16e-997af2880ce6 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:00.515282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 727/1464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:02.617820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e6c5-a845-4b8e-a286-7d1014c6af77 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:02.618349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e6c5-a845-4b8e-a286-7d1014c6af77 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:02.618349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60e6c5-a845-4b8e-a286-7d1014c6af77 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:02.619770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:02.625168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c633-785f-403a-a188-17809a3e376b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:02.625592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c633-785f-403a-a188-17809a3e376b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:02.625708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c633-785f-403a-a188-17809a3e376b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:02.690694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-2a52c633-785f-403a-a188-17809a3e376b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:02.691932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2a52c633-785f-403a-a188-17809a3e376b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:02.710846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:02.789076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:02.826904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60e6c5-a845-4b8e-a286-7d1014c6af77 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:02.828472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2b60e6c5-a845-4b8e-a286-7d1014c6af77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:02.929702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60e6c5-a845-4b8e-a286-7d1014c6af77 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:02.997494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:03.004554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c57c9f-6326-4d36-afa4-b2f959977104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:03.005200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c57c9f-6326-4d36-afa4-b2f959977104 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:03.005487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c57c9f-6326-4d36-afa4-b2f959977104 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:03.005759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c57c9f-6326-4d36-afa4-b2f959977104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:03.007472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f9c57c9f-6326-4d36-afa4-b2f959977104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:03.123162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c57c9f-6326-4d36-afa4-b2f959977104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:03.124622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c57c9f-6326-4d36-afa4-b2f959977104 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:03.143491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 739/1467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:05.230773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92509e8-4b7f-4bbd-b7af-8cacd5696f81 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:05.231338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92509e8-4b7f-4bbd-b7af-8cacd5696f81 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:05.231442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92509e8-4b7f-4bbd-b7af-8cacd5696f81 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:05.232800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:05.237977 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7290-4b8b-46fa-a514-d7d49d658dc0 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:05.238409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7290-4b8b-46fa-a514-d7d49d658dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:05.238573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f7290-4b8b-46fa-a514-d7d49d658dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:05.302987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a62f7290-4b8b-46fa-a514-d7d49d658dc0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:05.304231 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a62f7290-4b8b-46fa-a514-d7d49d658dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:05.351466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:05.399725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:05.437291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92509e8-4b7f-4bbd-b7af-8cacd5696f81 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:05.438778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a92509e8-4b7f-4bbd-b7af-8cacd5696f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:05.542597 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92509e8-4b7f-4bbd-b7af-8cacd5696f81 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:05.590848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:05.618698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf286d-590d-4fbb-910a-6b12e9ddf761 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:05.619928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf286d-590d-4fbb-910a-6b12e9ddf761 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:05.620246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf286d-590d-4fbb-910a-6b12e9ddf761 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:05.620669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf286d-590d-4fbb-910a-6b12e9ddf761 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:05.622444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2acf286d-590d-4fbb-910a-6b12e9ddf761 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:05.737364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf286d-590d-4fbb-910a-6b12e9ddf761 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:05.738758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf286d-590d-4fbb-910a-6b12e9ddf761 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:05.757079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 730/1470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:15.397834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=22 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:15.754771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=66 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:25.436214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66595dc4-531b-4402-951d-93242a985669 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:25.436764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66595dc4-531b-4402-951d-93242a985669 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:25.436764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66595dc4-531b-4402-951d-93242a985669 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:25.438156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 741/1471] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:25.443422 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314110-deac-43ac-8c6e-71ae46c091bc None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:25.443859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314110-deac-43ac-8c6e-71ae46c091bc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:25.443970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26314110-deac-43ac-8c6e-71ae46c091bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:25.507853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-26314110-deac-43ac-8c6e-71ae46c091bc None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:25.509678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-26314110-deac-43ac-8c6e-71ae46c091bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:25.603917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 731/1472] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:25.687885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452f639-0d65-4557-99fb-8106b98c99dd None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:25.688119 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452f639-0d65-4557-99fb-8106b98c99dd None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:25.688395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c452f639-0d65-4557-99fb-8106b98c99dd None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:25.689793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 742/1473] 10.222.0.48 () {54 vars in 966 bytes} [Thu Jul 21 04:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:25.694747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9328ef-6318-452a-85a8-e2f056d344de None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:25.695074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9328ef-6318-452a-85a8-e2f056d344de None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:25.695357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9328ef-6318-452a-85a8-e2f056d344de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:25.768339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-cc9328ef-6318-452a-85a8-e2f056d344de None None] MFA Rules not processed for user `e210e10ee6b649399de11ac719a89718`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:25.769529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-cc9328ef-6318-452a-85a8-e2f056d344de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:25.789276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:25.845110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 732/1474] 10.222.0.48 () {58 vars in 1063 bytes} [Thu Jul 21 04:12:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:25.852481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452f639-0d65-4557-99fb-8106b98c99dd None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:25.854525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c452f639-0d65-4557-99fb-8106b98c99dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:25.956670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c452f639-0d65-4557-99fb-8106b98c99dd None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:26.029030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1b2c4-7b8b-48ba-a5f3-d055c18bfa7e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210e10ee6b649399de11ac719a89718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:26.029647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1b2c4-7b8b-48ba-a5f3-d055c18bfa7e service glance] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:26.029929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1b2c4-7b8b-48ba-a5f3-d055c18bfa7e service glance] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:26.030202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1b2c4-7b8b-48ba-a5f3-d055c18bfa7e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:26.031871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-31f1b2c4-7b8b-48ba-a5f3-d055c18bfa7e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:26.085203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:26.140956 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1b2c4-7b8b-48ba-a5f3-d055c18bfa7e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:26.142419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1b2c4-7b8b-48ba-a5f3-d055c18bfa7e service glance] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:26.162321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 743/1475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:28.267135 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e240e-e829-4e8e-9f8d-df946a9e3247 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:28.267665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e240e-e829-4e8e-9f8d-df946a9e3247 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:28.267665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e240e-e829-4e8e-9f8d-df946a9e3247 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:28.269009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 733/1476] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:28.274414 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fc08c-e971-47ed-bf18-196a2f7e74d6 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:28.274840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fc08c-e971-47ed-bf18-196a2f7e74d6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:28.275017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782fc08c-e971-47ed-bf18-196a2f7e74d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:28.338168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-782fc08c-e971-47ed-bf18-196a2f7e74d6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:28.339402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-782fc08c-e971-47ed-bf18-196a2f7e74d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:28.436065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 744/1477] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:28.460024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e240e-e829-4e8e-9f8d-df946a9e3247 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:28.461593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bb9e240e-e829-4e8e-9f8d-df946a9e3247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:28.588502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e240e-e829-4e8e-9f8d-df946a9e3247 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:28.636319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:28.679481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20b1ad-9a99-4088-9c8b-afe6a7ec9010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:28.680140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b1ad-9a99-4088-9c8b-afe6a7ec9010 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:28.680421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b1ad-9a99-4088-9c8b-afe6a7ec9010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:28.680695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b1ad-9a99-4088-9c8b-afe6a7ec9010 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:28.681449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20b1ad-9a99-4088-9c8b-afe6a7ec9010 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:28.683254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WARNING py.warnings [None req-ee20b1ad-9a99-4088-9c8b-afe6a7ec9010 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:12:28.683254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: warnings.warn(msg) Jul 21 04:12:28.683254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: Jul 21 04:12:28.684404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20b1ad-9a99-4088-9c8b-afe6a7ec9010 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:28.704841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 734/1478] 10.222.0.48 () {56 vars in 1108 bytes} [Thu Jul 21 04:12:28 2022] GET /identity/v3/projects => generated 2553 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:12:30.776900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce074f3-5ba0-4308-a5be-fc76dffa3663 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:30.777466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce074f3-5ba0-4308-a5be-fc76dffa3663 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:30.777466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce074f3-5ba0-4308-a5be-fc76dffa3663 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:30.778838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 745/1479] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:30.784255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c270ec-7f0d-482a-89b3-6935536e0087 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:30.784663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c270ec-7f0d-482a-89b3-6935536e0087 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:30.784966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c270ec-7f0d-482a-89b3-6935536e0087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:30.849011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c6c270ec-7f0d-482a-89b3-6935536e0087 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:30.850243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c6c270ec-7f0d-482a-89b3-6935536e0087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:30.947142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 735/1480] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:30.989877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce074f3-5ba0-4308-a5be-fc76dffa3663 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:30.991515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7ce074f3-5ba0-4308-a5be-fc76dffa3663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:31.001916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:31.139390 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce074f3-5ba0-4308-a5be-fc76dffa3663 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:31.219084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:31.252118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9705ab2e-683c-4e0a-89b3-7011fa20657f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:31.252760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705ab2e-683c-4e0a-89b3-7011fa20657f service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:31.253040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705ab2e-683c-4e0a-89b3-7011fa20657f service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:31.253312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9705ab2e-683c-4e0a-89b3-7011fa20657f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:31.254934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9705ab2e-683c-4e0a-89b3-7011fa20657f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:31.342216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705ab2e-683c-4e0a-89b3-7011fa20657f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:31.343842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9705ab2e-683c-4e0a-89b3-7011fa20657f service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:31.361945 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 746/1481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:33.567998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b942b6e-e144-4570-aa1a-a93febddc1ee None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:33.568528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b942b6e-e144-4570-aa1a-a93febddc1ee None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:33.568528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b942b6e-e144-4570-aa1a-a93febddc1ee None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:33.569896 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 736/1482] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:12:33.575445 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955d34b-4df1-4869-80b7-69807a99a707 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:33.575852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955d34b-4df1-4869-80b7-69807a99a707 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:33.576000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955d34b-4df1-4869-80b7-69807a99a707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:33.640016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2955d34b-4df1-4869-80b7-69807a99a707 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:33.641214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2955d34b-4df1-4869-80b7-69807a99a707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:33.686218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:33.736473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 747/1483] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:33.772118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b942b6e-e144-4570-aa1a-a93febddc1ee None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:33.773684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8b942b6e-e144-4570-aa1a-a93febddc1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:33.797837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:33.876283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b942b6e-e144-4570-aa1a-a93febddc1ee None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:33.948342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc322f9-1254-45ba-b0a9-6149773228b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:33.948984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc322f9-1254-45ba-b0a9-6149773228b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:33.949262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc322f9-1254-45ba-b0a9-6149773228b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:33.949533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc322f9-1254-45ba-b0a9-6149773228b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:33.951177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6cc322f9-1254-45ba-b0a9-6149773228b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:34.023111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:34.059488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc322f9-1254-45ba-b0a9-6149773228b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:34.060947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc322f9-1254-45ba-b0a9-6149773228b5 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:34.080224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 737/1484] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:36.177530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159829f-2c97-4123-b1e7-c8b04fbc68df None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:36.178091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159829f-2c97-4123-b1e7-c8b04fbc68df None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:36.178091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159829f-2c97-4123-b1e7-c8b04fbc68df None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:36.179585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 748/1485] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:36.186073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f90274-ef50-44f4-a081-cc8d78c897ad None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:36.186450 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f90274-ef50-44f4-a081-cc8d78c897ad None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:36.186450 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f90274-ef50-44f4-a081-cc8d78c897ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:36.252025 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-24f90274-ef50-44f4-a081-cc8d78c897ad None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:36.253113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-24f90274-ef50-44f4-a081-cc8d78c897ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:36.349448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 738/1486] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:36.388412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159829f-2c97-4123-b1e7-c8b04fbc68df None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:36.389956 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1159829f-2c97-4123-b1e7-c8b04fbc68df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:36.492248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159829f-2c97-4123-b1e7-c8b04fbc68df None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:36.567996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:36.569798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62096f4-8268-4352-b578-758eaae86fca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:36.570420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62096f4-8268-4352-b578-758eaae86fca service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:36.570709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62096f4-8268-4352-b578-758eaae86fca service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:36.571086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62096f4-8268-4352-b578-758eaae86fca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:36.573568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e62096f4-8268-4352-b578-758eaae86fca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:36.682981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62096f4-8268-4352-b578-758eaae86fca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:36.684538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62096f4-8268-4352-b578-758eaae86fca service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:36.703322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 749/1487] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:38.814496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9f96-4e84-4c4d-aec8-672200c4a53c None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:38.815057 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9f96-4e84-4c4d-aec8-672200c4a53c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:38.815057 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd9f96-4e84-4c4d-aec8-672200c4a53c None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:38.816518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 739/1488] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:38.822778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b4c5e-21c4-42a8-92fa-b69e594c5cc8 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:38.823209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b4c5e-21c4-42a8-92fa-b69e594c5cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:38.823378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7b4c5e-21c4-42a8-92fa-b69e594c5cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:38.888858 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1c7b4c5e-21c4-42a8-92fa-b69e594c5cc8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:38.889983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1c7b4c5e-21c4-42a8-92fa-b69e594c5cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:38.944850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:38.989961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 750/1489] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:39.036805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9f96-4e84-4c4d-aec8-672200c4a53c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:39.038372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1ffd9f96-4e84-4c4d-aec8-672200c4a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:39.074420 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:39.141353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffd9f96-4e84-4c4d-aec8-672200c4a53c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:39.217430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49476354-d61f-437d-870d-836c1b774688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:39.218083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49476354-d61f-437d-870d-836c1b774688 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:39.218368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49476354-d61f-437d-870d-836c1b774688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:39.218647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49476354-d61f-437d-870d-836c1b774688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:39.220324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-49476354-d61f-437d-870d-836c1b774688 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:39.303351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:39.332736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49476354-d61f-437d-870d-836c1b774688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:39.334189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49476354-d61f-437d-870d-836c1b774688 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:39.353083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 740/1490] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:41.665849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5604443-6bb6-4cb5-8ed6-e8b050886ee3 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:41.666416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5604443-6bb6-4cb5-8ed6-e8b050886ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:41.666416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5604443-6bb6-4cb5-8ed6-e8b050886ee3 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:41.667849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 751/1491] 10.222.0.48 () {54 vars in 926 bytes} [Thu Jul 21 04:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:12:41.673189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e88aff-5c37-412f-88ae-e081225123a3 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:41.673637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e88aff-5c37-412f-88ae-e081225123a3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:41.673742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e88aff-5c37-412f-88ae-e081225123a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:41.737731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-01e88aff-5c37-412f-88ae-e081225123a3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:12:41.738920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-01e88aff-5c37-412f-88ae-e081225123a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:41.835366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 741/1492] 10.222.0.48 () {58 vars in 1023 bytes} [Thu Jul 21 04:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:12:41.874321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5604443-6bb6-4cb5-8ed6-e8b050886ee3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:12:41.875951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b5604443-6bb6-4cb5-8ed6-e8b050886ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:41.981692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5604443-6bb6-4cb5-8ed6-e8b050886ee3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:12:42.057858 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20af2f2-2dd3-4b75-ba18-64ce75d91325 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:12:42.058517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af2f2-2dd3-4b75-ba18-64ce75d91325 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:12:42.058805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af2f2-2dd3-4b75-ba18-64ce75d91325 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:12:42.059128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af2f2-2dd3-4b75-ba18-64ce75d91325 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:12:42.060817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b20af2f2-2dd3-4b75-ba18-64ce75d91325 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:12:42.070213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:42.171003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20af2f2-2dd3-4b75-ba18-64ce75d91325 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:12:42.172454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20af2f2-2dd3-4b75-ba18-64ce75d91325 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:12:42.191216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 752/1493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:12:51.833295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=82 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:12:52.188790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=50 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:15.201810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cdbb8-4bd3-4006-8b89-2572434e09e1 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:15.202304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cdbb8-4bd3-4006-8b89-2572434e09e1 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:15.202436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29cdbb8-4bd3-4006-8b89-2572434e09e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:15.275569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e29cdbb8-4bd3-4006-8b89-2572434e09e1 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:14:15.276785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e29cdbb8-4bd3-4006-8b89-2572434e09e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:15.372834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 742/1494] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:14:15.380974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9d2f5-9cf9-4eea-b978-e4e69f7fc254 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:15.381461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9d2f5-9cf9-4eea-b978-e4e69f7fc254 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:15.381566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9d2f5-9cf9-4eea-b978-e4e69f7fc254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:15.456804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fcd9d2f5-9cf9-4eea-b978-e4e69f7fc254 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:14:15.457924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fcd9d2f5-9cf9-4eea-b978-e4e69f7fc254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:15.556071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 753/1495] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:14:15.560731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cdbb8-4bd3-4006-8b89-2572434e09e1 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:15.561961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e29cdbb8-4bd3-4006-8b89-2572434e09e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:15.573675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29cdbb8-4bd3-4006-8b89-2572434e09e1 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:15.634270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:15.668633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:15.669301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:15.669578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:15.669849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:15.670569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:14:15.670869 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:15.671917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WARNING py.warnings [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:15.671917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: warnings.warn(msg) Jul 21 04:14:15.671917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: Jul 21 04:14:15.672820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:15.684164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 743/1496] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:14:15.696797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9d2f5-9cf9-4eea-b978-e4e69f7fc254 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:15.706187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9d2f5-9cf9-4eea-b978-e4e69f7fc254 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:15.771155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:15.804992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bfe2b-5c0a-4836-9aa0-ed5c74dc593e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:15.805638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bfe2b-5c0a-4836-9aa0-ed5c74dc593e admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:15.805917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bfe2b-5c0a-4836-9aa0-ed5c74dc593e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:15.806186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45bfe2b-5c0a-4836-9aa0-ed5c74dc593e admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:15.806869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bfe2b-5c0a-4836-9aa0-ed5c74dc593e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:15.808683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: WARNING py.warnings [None req-f45bfe2b-5c0a-4836-9aa0-ed5c74dc593e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:15.808683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: warnings.warn(msg) Jul 21 04:14:15.808683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: Jul 21 04:14:15.809890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45bfe2b-5c0a-4836-9aa0-ed5c74dc593e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:15.864631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 754/1497] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:14:15 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:14:15.869008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:15.870575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:15.904590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b310e006-97d7-412c-b4bf-ac4d955f26a6 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:16.021447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec4913-24ae-4a97-8438-b44ad2ff2f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:16.022049 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4913-24ae-4a97-8438-b44ad2ff2f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:16.022358 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4913-24ae-4a97-8438-b44ad2ff2f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:16.023241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ec4913-24ae-4a97-8438-b44ad2ff2f8b admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:16.023917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec4913-24ae-4a97-8438-b44ad2ff2f8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:16.024932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WARNING py.warnings [None req-d9ec4913-24ae-4a97-8438-b44ad2ff2f8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:16.024932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: warnings.warn(msg) Jul 21 04:14:16.024932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: Jul 21 04:14:16.026146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ec4913-24ae-4a97-8438-b44ad2ff2f8b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:16.066531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 744/1498] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:14:15 2022] POST /identity/v3/users => generated 289 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:14:16.071328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bfe2b-5c0a-4836-9aa0-ed5c74dc593e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:16.073166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f45bfe2b-5c0a-4836-9aa0-ed5c74dc593e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:16.134536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45bfe2b-5c0a-4836-9aa0-ed5c74dc593e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:16.218022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:16.229759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbc563-799d-47a7-9150-49b528715548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:16.230432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc563-799d-47a7-9150-49b528715548 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:16.230714 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc563-799d-47a7-9150-49b528715548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:16.231017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bbc563-799d-47a7-9150-49b528715548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:16.231748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbc563-799d-47a7-9150-49b528715548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:16.232774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: WARNING py.warnings [None req-77bbc563-799d-47a7-9150-49b528715548 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:16.232774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: warnings.warn(msg) Jul 21 04:14:16.232774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: Jul 21 04:14:16.233664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bbc563-799d-47a7-9150-49b528715548 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:16.246618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 755/1499] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:14:16.250630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec4913-24ae-4a97-8438-b44ad2ff2f8b admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:16.252184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d9ec4913-24ae-4a97-8438-b44ad2ff2f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:16.264231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ec4913-24ae-4a97-8438-b44ad2ff2f8b admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:16.289266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:16.358747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0764411a-abe3-4f2b-be8e-120c548178c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:16.359439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764411a-abe3-4f2b-be8e-120c548178c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:16.359720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764411a-abe3-4f2b-be8e-120c548178c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:16.359992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0764411a-abe3-4f2b-be8e-120c548178c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:16.360711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764411a-abe3-4f2b-be8e-120c548178c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:16.361727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WARNING py.warnings [None req-0764411a-abe3-4f2b-be8e-120c548178c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:16.361727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: warnings.warn(msg) Jul 21 04:14:16.361727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: Jul 21 04:14:16.362606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0764411a-abe3-4f2b-be8e-120c548178c2 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:16.375161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 745/1500] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:14:16.379440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbc563-799d-47a7-9150-49b528715548 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:16.380986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-77bbc563-799d-47a7-9150-49b528715548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:16.414244 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bbc563-799d-47a7-9150-49b528715548 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:16.508783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235154c3-9805-46fd-9da9-51b799702d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:16.509669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235154c3-9805-46fd-9da9-51b799702d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:16.509953 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235154c3-9805-46fd-9da9-51b799702d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:16.510229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235154c3-9805-46fd-9da9-51b799702d0e admin admin] PATH_INFO: `/v3/projects/36ca9db94f174a6cad11d704ff9e65cc/users/954ef9f126694266b5a76534783025fe/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:16.532506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235154c3-9805-46fd-9da9-51b799702d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=36ca9db94f174a6cad11d704ff9e65cc, user_id=954ef9f126694266b5a76534783025fe, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:16.533558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: WARNING py.warnings [None req-235154c3-9805-46fd-9da9-51b799702d0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:16.533558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: warnings.warn(msg) Jul 21 04:14:16.533558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: Jul 21 04:14:16.535559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235154c3-9805-46fd-9da9-51b799702d0e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:16.565748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 756/1501] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:14:16 2022] PUT /identity/v3/projects/36ca9db94f174a6cad11d704ff9e65cc/users/954ef9f126694266b5a76534783025fe/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:14:16.578478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4d571-fae4-44fe-9683-cb86b05092de None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:16.578767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4d571-fae4-44fe-9683-cb86b05092de None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:16.579087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4d571-fae4-44fe-9683-cb86b05092de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:16.634904 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e9d4d571-fae4-44fe-9683-cb86b05092de None None] MFA Rules not processed for user `954ef9f126694266b5a76534783025fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:14:16.636199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e9d4d571-fae4-44fe-9683-cb86b05092de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:16.713453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 746/1502] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:14:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:14:16.726684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9964-df6d-4280-a43f-d504363b74ff None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:16.727010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9964-df6d-4280-a43f-d504363b74ff None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:16.727295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaa9964-df6d-4280-a43f-d504363b74ff None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:16.728669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 757/1503] 10.222.0.48 () {54 vars in 964 bytes} [Thu Jul 21 04:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:14:16.733505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54647e-8c1e-4c85-82eb-2ebe7c193a92 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:16.733800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54647e-8c1e-4c85-82eb-2ebe7c193a92 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:16.734081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54647e-8c1e-4c85-82eb-2ebe7c193a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:16.763827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:16.807895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-aa54647e-8c1e-4c85-82eb-2ebe7c193a92 None None] MFA Rules not processed for user `92407a5a276247e79d2abe41fee54c33`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:14:16.809038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-aa54647e-8c1e-4c85-82eb-2ebe7c193a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:16.883555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 747/1504] 10.222.0.48 () {58 vars in 1061 bytes} [Thu Jul 21 04:14:16 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:14:16.891251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa9964-df6d-4280-a43f-d504363b74ff None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:16.892825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-baaa9964-df6d-4280-a43f-d504363b74ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:16.946104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:17.001838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaa9964-df6d-4280-a43f-d504363b74ff None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:17.076943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95023a8-c9e0-49e9-a9e7-c8053d481d51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:17.077511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95023a8-c9e0-49e9-a9e7-c8053d481d51 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:17.077789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95023a8-c9e0-49e9-a9e7-c8053d481d51 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:17.078061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95023a8-c9e0-49e9-a9e7-c8053d481d51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:17.079722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a95023a8-c9e0-49e9-a9e7-c8053d481d51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:17.176485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95023a8-c9e0-49e9-a9e7-c8053d481d51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:17.177939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95023a8-c9e0-49e9-a9e7-c8053d481d51 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:17.182211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:17.198041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 758/1505] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:14:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:14:17.238723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d40347-be07-4d89-95fc-07a237804efb None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:17.239050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d40347-be07-4d89-95fc-07a237804efb None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:17.239338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d40347-be07-4d89-95fc-07a237804efb None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:17.240644 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 748/1506] 10.222.0.48 () {52 vars in 829 bytes} [Thu Jul 21 04:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:14:17.244657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95023a8-c9e0-49e9-a9e7-c8053d481d51 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:17.245894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a95023a8-c9e0-49e9-a9e7-c8053d481d51 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:17.343024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95023a8-c9e0-49e9-a9e7-c8053d481d51 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:17.437277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:17.438167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:17.438446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:17.438717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] PATH_INFO: `/v3/users/954ef9f126694266b5a76534783025fe` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:17.450857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=954ef9f126694266b5a76534783025fe)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:17.451940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: WARNING py.warnings [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:17.451940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: warnings.warn(msg) Jul 21 04:14:17.451940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: Jul 21 04:14:17.453143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:17.462659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:17.516186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '954ef9f126694266b5a76534783025fe'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:17.516723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '954ef9f126694266b5a76534783025fe'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:17.517140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '954ef9f126694266b5a76534783025fe'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:17.530695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '954ef9f126694266b5a76534783025fe'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:17.540138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '954ef9f126694266b5a76534783025fe'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:17.684942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 759/1507] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:14:17 2022] DELETE /identity/v3/users/954ef9f126694266b5a76534783025fe => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:14:17.689461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9c157-3e76-47b8-8b1d-4bf0adf5f6b3 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:17.689933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9c157-3e76-47b8-8b1d-4bf0adf5f6b3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:17.690050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a9c157-3e76-47b8-8b1d-4bf0adf5f6b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:17.746251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-54a9c157-3e76-47b8-8b1d-4bf0adf5f6b3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:14:17.747487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-54a9c157-3e76-47b8-8b1d-4bf0adf5f6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:17.941418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:17.954703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 749/1508] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:14:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:14:17.965400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:17.966685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:18.067281 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6501c-d254-4152-922c-a10efe9d0c4f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:18.122304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:18.142373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3ca97-aa86-49b7-b5ad-90b3f0b976a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:18.143055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3ca97-aa86-49b7-b5ad-90b3f0b976a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:18.143347 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3ca97-aa86-49b7-b5ad-90b3f0b976a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:18.143628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3ca97-aa86-49b7-b5ad-90b3f0b976a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:18.145307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-bec3ca97-aa86-49b7-b5ad-90b3f0b976a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:18.256898 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3ca97-aa86-49b7-b5ad-90b3f0b976a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:18.258273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3ca97-aa86-49b7-b5ad-90b3f0b976a7 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:18.276143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 760/1509] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:14:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:14:18.628123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9c157-3e76-47b8-8b1d-4bf0adf5f6b3 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:14:18.629426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-54a9c157-3e76-47b8-8b1d-4bf0adf5f6b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:14:18.641180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a9c157-3e76-47b8-8b1d-4bf0adf5f6b3 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:14:18.746478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:14:18.747368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:14:18.747651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:14:18.747924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] PATH_INFO: `/v3/projects/36ca9db94f174a6cad11d704ff9e65cc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:14:18.758933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36ca9db94f174a6cad11d704ff9e65cc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:14:18.759998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WARNING py.warnings [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:14:18.759998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: warnings.warn(msg) Jul 21 04:14:18.759998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: Jul 21 04:14:18.761247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:14:18.817271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36ca9db94f174a6cad11d704ff9e65cc', 'request_id': 'req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:18.827482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36ca9db94f174a6cad11d704ff9e65cc', 'request_id': 'req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:18.833656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36ca9db94f174a6cad11d704ff9e65cc', 'request_id': 'req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:18.863894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] The token cache is being invalidate because project 36ca9db94f174a6cad11d704ff9e65cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:14:18.864258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:18.864821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-643cacc5-38d2-45df-9aa8-ad6199ddf3f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:14:18.866800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 750/1510] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:14:18 2022] DELETE /identity/v3/projects/36ca9db94f174a6cad11d704ff9e65cc => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:14:28.274155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=62 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:14:28.861599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:16:00.349057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9984-111a-48ac-952c-81addeb8e10b None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:00.349630 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9984-111a-48ac-952c-81addeb8e10b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:00.349630 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37a9984-111a-48ac-952c-81addeb8e10b None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:00.350975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:00.355858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bc2c8-2887-4109-9e53-469470f533e8 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:00.356316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bc2c8-2887-4109-9e53-469470f533e8 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:00.356433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bc2c8-2887-4109-9e53-469470f533e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:00.436986 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-062bc2c8-2887-4109-9e53-469470f533e8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:00.438187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-062bc2c8-2887-4109-9e53-469470f533e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:00.538527 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:00.695625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a9984-111a-48ac-952c-81addeb8e10b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:00.698322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b37a9984-111a-48ac-952c-81addeb8e10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:00.817886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37a9984-111a-48ac-952c-81addeb8e10b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:00.824694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1629e-d496-4e82-adf8-31cc39e8fe2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:00.825367 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1629e-d496-4e82-adf8-31cc39e8fe2a service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:00.825652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1629e-d496-4e82-adf8-31cc39e8fe2a service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:00.825958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1629e-d496-4e82-adf8-31cc39e8fe2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:00.834210 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1629e-d496-4e82-adf8-31cc39e8fe2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:00.835842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1629e-d496-4e82-adf8-31cc39e8fe2a service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:00.845905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 762/1513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:01.676432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd699c-7045-4ce4-9c5b-6364b4ab17ef None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:01.676982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd699c-7045-4ce4-9c5b-6364b4ab17ef None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:01.676982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdd699c-7045-4ce4-9c5b-6364b4ab17ef None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:01.678673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:01.684217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626d4e-7a89-4cca-9a98-002a72e23b01 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:01.684668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626d4e-7a89-4cca-9a98-002a72e23b01 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:01.684863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32626d4e-7a89-4cca-9a98-002a72e23b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:01.702753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-32626d4e-7a89-4cca-9a98-002a72e23b01 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:01.703985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-32626d4e-7a89-4cca-9a98-002a72e23b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:01.713403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:16:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:01.863951 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd699c-7045-4ce4-9c5b-6364b4ab17ef None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:01.878642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdd699c-7045-4ce4-9c5b-6364b4ab17ef None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:01.884495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3100ca6-dc67-4c9f-94d7-27e36afbd6ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:01.885120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3100ca6-dc67-4c9f-94d7-27e36afbd6ff service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:01.885398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3100ca6-dc67-4c9f-94d7-27e36afbd6ff service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:01.885669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3100ca6-dc67-4c9f-94d7-27e36afbd6ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:01.893702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3100ca6-dc67-4c9f-94d7-27e36afbd6ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:01.895319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3100ca6-dc67-4c9f-94d7-27e36afbd6ff service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:01.904594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 753/1516] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:02.514487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05beb1a-f87a-4d29-bddb-4f1d111f38a7 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:02.514706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05beb1a-f87a-4d29-bddb-4f1d111f38a7 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:02.514971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05beb1a-f87a-4d29-bddb-4f1d111f38a7 None None] PATH_INFO: `/v3` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:02.516295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 764/1517] 10.222.0.49 () {54 vars in 925 bytes} [Thu Jul 21 04:16:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:16:02.522573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c1f1-c840-436b-af25-dcf973e894dd None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:02.522861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c1f1-c840-436b-af25-dcf973e894dd None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:02.523163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c1f1-c840-436b-af25-dcf973e894dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:02.581689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1bd0c1f1-c840-436b-af25-dcf973e894dd None None] MFA Rules not processed for user `8572e4c550014fc4b1aea3ddf16f7d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:02.582862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1bd0c1f1-c840-436b-af25-dcf973e894dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:02.599479 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:16:02.654533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 754/1518] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jul 21 04:16:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:11.698142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=56 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:16:11.807044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed5d6-b244-40ea-a5dc-a2166923b487 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:11.807895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed5d6-b244-40ea-a5dc-a2166923b487 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:11.808145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12ed5d6-b244-40ea-a5dc-a2166923b487 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:11.809514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 765/1519] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jul 21 04:16:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:11.814493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366e5ac-1db0-4076-9455-d78233d5a05d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:11.814927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366e5ac-1db0-4076-9455-d78233d5a05d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:11.815078 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366e5ac-1db0-4076-9455-d78233d5a05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:11.833317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-9366e5ac-1db0-4076-9455-d78233d5a05d None None] MFA Rules not processed for user `8572e4c550014fc4b1aea3ddf16f7d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:11.834497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9366e5ac-1db0-4076-9455-d78233d5a05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:11.846667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 755/1520] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jul 21 04:16:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:11.856887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed5d6-b244-40ea-a5dc-a2166923b487 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:11.870834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12ed5d6-b244-40ea-a5dc-a2166923b487 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:11.876065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12f6f0-5c14-442c-9071-b0c6dfa2c57b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:11.876706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12f6f0-5c14-442c-9071-b0c6dfa2c57b service placement] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:11.876992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12f6f0-5c14-442c-9071-b0c6dfa2c57b service placement] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:11.877272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12f6f0-5c14-442c-9071-b0c6dfa2c57b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:11.885897 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12f6f0-5c14-442c-9071-b0c6dfa2c57b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:11.887542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12f6f0-5c14-442c-9071-b0c6dfa2c57b service placement] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:11.897423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 766/1521] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:13.170785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59a12-3901-4cd5-9b10-9d45fc8321a9 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:13.171357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59a12-3901-4cd5-9b10-9d45fc8321a9 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:13.171357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f59a12-3901-4cd5-9b10-9d45fc8321a9 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:13.172783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:13.177822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f60ed-d7ec-4d6c-93b1-89caefe607e8 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:13.178218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f60ed-d7ec-4d6c-93b1-89caefe607e8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:13.178368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16f60ed-d7ec-4d6c-93b1-89caefe607e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:13.196749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c16f60ed-d7ec-4d6c-93b1-89caefe607e8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:13.198660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c16f60ed-d7ec-4d6c-93b1-89caefe607e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:13.206495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:13.359978 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59a12-3901-4cd5-9b10-9d45fc8321a9 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:13.375540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f59a12-3901-4cd5-9b10-9d45fc8321a9 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:13.381030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8480d5-d425-439b-a5af-ac0b9e17cf90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:13.381665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8480d5-d425-439b-a5af-ac0b9e17cf90 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:13.381952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8480d5-d425-439b-a5af-ac0b9e17cf90 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:13.382233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8480d5-d425-439b-a5af-ac0b9e17cf90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:13.390432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8480d5-d425-439b-a5af-ac0b9e17cf90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:13.392088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8480d5-d425-439b-a5af-ac0b9e17cf90 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:13.401777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 757/1524] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:14.245942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578155b-94f3-4f15-8227-2fd951eec3d0 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:14.246505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578155b-94f3-4f15-8227-2fd951eec3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:14.246505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578155b-94f3-4f15-8227-2fd951eec3d0 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:14.247910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 21 04:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:14.252703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd8e8-4a1c-4180-abe9-a0fc575772dd None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:14.253149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd8e8-4a1c-4180-abe9-a0fc575772dd None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:14.253250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461cd8e8-4a1c-4180-abe9-a0fc575772dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:14.270976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-461cd8e8-4a1c-4180-abe9-a0fc575772dd None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:14.272173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-461cd8e8-4a1c-4180-abe9-a0fc575772dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:14.280122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 21 04:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:16:14.429173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578155b-94f3-4f15-8227-2fd951eec3d0 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:14.444015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a578155b-94f3-4f15-8227-2fd951eec3d0 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:14.449699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47feb08-1219-4eb1-91d4-0cb40acecced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:14.450330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47feb08-1219-4eb1-91d4-0cb40acecced service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:14.450615 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47feb08-1219-4eb1-91d4-0cb40acecced service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:14.450892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47feb08-1219-4eb1-91d4-0cb40acecced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:14.458901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47feb08-1219-4eb1-91d4-0cb40acecced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:14.460522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47feb08-1219-4eb1-91d4-0cb40acecced service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:14.470266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 769/1527] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:18.307905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0e64-f6d2-4fd3-b5c3-79fed3bf6721 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:18.308434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0e64-f6d2-4fd3-b5c3-79fed3bf6721 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:18.308434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b0e64-f6d2-4fd3-b5c3-79fed3bf6721 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:18.309830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:18.315006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175cefd-0b9e-4f57-8d77-981017a1b8b6 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:18.315397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175cefd-0b9e-4f57-8d77-981017a1b8b6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:18.315587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d175cefd-0b9e-4f57-8d77-981017a1b8b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:18.333992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d175cefd-0b9e-4f57-8d77-981017a1b8b6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:18.335228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d175cefd-0b9e-4f57-8d77-981017a1b8b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:18.343154 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:16:18.415123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b0e64-f6d2-4fd3-b5c3-79fed3bf6721 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:18.417157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a52b0e64-f6d2-4fd3-b5c3-79fed3bf6721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:18.495819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b0e64-f6d2-4fd3-b5c3-79fed3bf6721 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:18.499445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cc29f1-c0cf-4081-a1d2-c81a1e0115c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:18.500084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc29f1-c0cf-4081-a1d2-c81a1e0115c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:18.500369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc29f1-c0cf-4081-a1d2-c81a1e0115c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:18.500649 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cc29f1-c0cf-4081-a1d2-c81a1e0115c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:18.509602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc29f1-c0cf-4081-a1d2-c81a1e0115c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:18.511675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cc29f1-c0cf-4081-a1d2-c81a1e0115c6 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:18.521065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 760/1530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:20.557922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66fda-443d-4ab1-a2b1-8f5b0ff11830 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:20.558503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66fda-443d-4ab1-a2b1-8f5b0ff11830 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:20.558503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e66fda-443d-4ab1-a2b1-8f5b0ff11830 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:20.559885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:20.565071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72127bf-ff56-4fc2-a7da-3be9fc9d2ade None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:20.565465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72127bf-ff56-4fc2-a7da-3be9fc9d2ade None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:20.565669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72127bf-ff56-4fc2-a7da-3be9fc9d2ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:20.583049 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-a72127bf-ff56-4fc2-a7da-3be9fc9d2ade None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:20.584258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a72127bf-ff56-4fc2-a7da-3be9fc9d2ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:20.592485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:20.628673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e66fda-443d-4ab1-a2b1-8f5b0ff11830 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:20.639975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e66fda-443d-4ab1-a2b1-8f5b0ff11830 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:20.643868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b807076-eb5a-4848-8707-553ddbd4dbf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:20.644080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b807076-eb5a-4848-8707-553ddbd4dbf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:20.644403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b807076-eb5a-4848-8707-553ddbd4dbf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:20.644638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b807076-eb5a-4848-8707-553ddbd4dbf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:20.654233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b807076-eb5a-4848-8707-553ddbd4dbf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:20.655700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b807076-eb5a-4848-8707-553ddbd4dbf1 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:20.665057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 772/1533] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:24.100214 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f247661-626c-4dbf-9e5b-f02016ce3436 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:24.100712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f247661-626c-4dbf-9e5b-f02016ce3436 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:24.100822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f247661-626c-4dbf-9e5b-f02016ce3436 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:24.102170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:24.108061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883e1e4-474b-436c-9d76-81b529c8db50 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:24.108488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883e1e4-474b-436c-9d76-81b529c8db50 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:24.108631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883e1e4-474b-436c-9d76-81b529c8db50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:24.130161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c883e1e4-474b-436c-9d76-81b529c8db50 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:24.131388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c883e1e4-474b-436c-9d76-81b529c8db50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:24.139891 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:24.443147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f247661-626c-4dbf-9e5b-f02016ce3436 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:24.445068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0f247661-626c-4dbf-9e5b-f02016ce3436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:24.545740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:16:24.560534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f247661-626c-4dbf-9e5b-f02016ce3436 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:24.564130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21436c2-dddb-4f17-94ec-3845622236c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:24.564802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21436c2-dddb-4f17-94ec-3845622236c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:24.565087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21436c2-dddb-4f17-94ec-3845622236c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:24.565366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21436c2-dddb-4f17-94ec-3845622236c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:24.575466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21436c2-dddb-4f17-94ec-3845622236c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:24.576901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21436c2-dddb-4f17-94ec-3845622236c7 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:24.586181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 763/1536] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:26.650379 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867a15b-1c32-4216-a5b0-1d7bc8cb5c1b None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:26.650943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867a15b-1c32-4216-a5b0-1d7bc8cb5c1b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:26.650943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867a15b-1c32-4216-a5b0-1d7bc8cb5c1b None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:26.652372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 21 04:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:16:26.657585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d512-589e-4da1-8923-1c4bf358376a None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:26.657970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d512-589e-4da1-8923-1c4bf358376a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:26.658137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894d512-589e-4da1-8923-1c4bf358376a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:26.675540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-0894d512-589e-4da1-8923-1c4bf358376a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:16:26.676733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0894d512-589e-4da1-8923-1c4bf358376a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:26.685290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 21 04:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:16:26.987273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867a15b-1c32-4216-a5b0-1d7bc8cb5c1b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:16:26.988967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3867a15b-1c32-4216-a5b0-1d7bc8cb5c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:16:27.002566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867a15b-1c32-4216-a5b0-1d7bc8cb5c1b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:16:27.006049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f818962-be5e-4f58-855f-f8359053c8be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:16:27.006672 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f818962-be5e-4f58-855f-f8359053c8be service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:16:27.006967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f818962-be5e-4f58-855f-f8359053c8be service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:16:27.007265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f818962-be5e-4f58-855f-f8359053c8be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:16:27.016041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f818962-be5e-4f58-855f-f8359053c8be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:16:27.017469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f818962-be5e-4f58-855f-f8359053c8be service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:16:27.027018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 775/1539] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:16:36.670772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=11 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:16:37.022934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=33 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:06.494816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2371f-30e4-4ca0-b4fc-f89a32b854fd None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.497252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2371f-30e4-4ca0-b4fc-f89a32b854fd None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.497252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2371f-30e4-4ca0-b4fc-f89a32b854fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.524217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-74d2371f-30e4-4ca0-b4fc-f89a32b854fd None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.525609 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-74d2371f-30e4-4ca0-b4fc-f89a32b854fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.534437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 765/1540] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.542839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114a516-2455-44fe-8cf4-3b6ce4b708d3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.546300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114a516-2455-44fe-8cf4-3b6ce4b708d3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.546300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1114a516-2455-44fe-8cf4-3b6ce4b708d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.549088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c3015-5dd3-45cb-b1c6-b43164cd459f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.549383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c3015-5dd3-45cb-b1c6-b43164cd459f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.549667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c3015-5dd3-45cb-b1c6-b43164cd459f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.576488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1114a516-2455-44fe-8cf4-3b6ce4b708d3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.577889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1114a516-2455-44fe-8cf4-3b6ce4b708d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.585353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-b13c3015-5dd3-45cb-b1c6-b43164cd459f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.586586 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b13c3015-5dd3-45cb-b1c6-b43164cd459f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.596495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 776/1541] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.606505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 766/1542] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:06.607754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84972300-3314-4a57-b5ed-c7f8d284eca2 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.608044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84972300-3314-4a57-b5ed-c7f8d284eca2 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.608375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84972300-3314-4a57-b5ed-c7f8d284eca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.612484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c3015-5dd3-45cb-b1c6-b43164cd459f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.627770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c3015-5dd3-45cb-b1c6-b43164cd459f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.639709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-84972300-3314-4a57-b5ed-c7f8d284eca2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.641032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-84972300-3314-4a57-b5ed-c7f8d284eca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.646260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d048941-dcb5-433d-98b9-063be84704e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.646947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d048941-dcb5-433d-98b9-063be84704e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.647255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d048941-dcb5-433d-98b9-063be84704e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.647537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d048941-dcb5-433d-98b9-063be84704e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.648279 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d048941-dcb5-433d-98b9-063be84704e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:06.648592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d048941-dcb5-433d-98b9-063be84704e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.650233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d048941-dcb5-433d-98b9-063be84704e5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.654766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 777/1543] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.659893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84972300-3314-4a57-b5ed-c7f8d284eca2 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.673859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84972300-3314-4a57-b5ed-c7f8d284eca2 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.682790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 767/1544] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:18:06.683965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba166e8-690e-4d83-97ed-a3e08840a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.684689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba166e8-690e-4d83-97ed-a3e08840a1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.684979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba166e8-690e-4d83-97ed-a3e08840a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.685254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba166e8-690e-4d83-97ed-a3e08840a1fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.686065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba166e8-690e-4d83-97ed-a3e08840a1fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:06.686358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba166e8-690e-4d83-97ed-a3e08840a1fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.687468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: WARNING py.warnings [None req-3ba166e8-690e-4d83-97ed-a3e08840a1fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:06.687468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: warnings.warn(msg) Jul 21 04:18:06.687468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: Jul 21 04:18:06.688346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba166e8-690e-4d83-97ed-a3e08840a1fb admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.695010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d048941-dcb5-433d-98b9-063be84704e5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.712019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 778/1545] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:06.721391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba166e8-690e-4d83-97ed-a3e08840a1fb admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.725560 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d048941-dcb5-433d-98b9-063be84704e5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.739005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba166e8-690e-4d83-97ed-a3e08840a1fb admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.743564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f50e0cb-8742-4c4b-8745-092d58ad993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.744238 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e0cb-8742-4c4b-8745-092d58ad993d admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.744520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e0cb-8742-4c4b-8745-092d58ad993d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.744800 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f50e0cb-8742-4c4b-8745-092d58ad993d admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.745554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50e0cb-8742-4c4b-8745-092d58ad993d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.747500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f50e0cb-8742-4c4b-8745-092d58ad993d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.748871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07504b9f-1715-48e5-aa30-7cba3f0f0864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.749543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07504b9f-1715-48e5-aa30-7cba3f0f0864 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.749833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07504b9f-1715-48e5-aa30-7cba3f0f0864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.750109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07504b9f-1715-48e5-aa30-7cba3f0f0864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.750812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07504b9f-1715-48e5-aa30-7cba3f0f0864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.751865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WARNING py.warnings [None req-07504b9f-1715-48e5-aa30-7cba3f0f0864 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:06.751865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: warnings.warn(msg) Jul 21 04:18:06.751865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: Jul 21 04:18:06.753295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07504b9f-1715-48e5-aa30-7cba3f0f0864 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.820959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 779/1546] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:06.822658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ecee9-e776-4373-9749-2e3a009db64e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.822984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ecee9-e776-4373-9749-2e3a009db64e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.824051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ecee9-e776-4373-9749-2e3a009db64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.847075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 768/1547] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/projects => generated 379 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:06.848647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc59a8-a4b4-4763-be70-0a249e2252c8 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.849571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc59a8-a4b4-4763-be70-0a249e2252c8 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.849866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc59a8-a4b4-4763-be70-0a249e2252c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.860432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a00ecee9-e776-4373-9749-2e3a009db64e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.861766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a00ecee9-e776-4373-9749-2e3a009db64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.874147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-37fc59a8-a4b4-4763-be70-0a249e2252c8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.876093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-37fc59a8-a4b4-4763-be70-0a249e2252c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.936844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 780/1548] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.937636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ecee9-e776-4373-9749-2e3a009db64e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:06.947685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 769/1549] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.948331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ecee9-e776-4373-9749-2e3a009db64e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:06.949236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2136-0c79-4e29-a002-8b38013360a8 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.949589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2136-0c79-4e29-a002-8b38013360a8 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.949927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c2136-0c79-4e29-a002-8b38013360a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.961360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c14d47-bbd0-45af-91d1-d25d373c4b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:06.962138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c14d47-bbd0-45af-91d1-d25d373c4b7f admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.962550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c14d47-bbd0-45af-91d1-d25d373c4b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.963462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c14d47-bbd0-45af-91d1-d25d373c4b7f admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.964246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c14d47-bbd0-45af-91d1-d25d373c4b7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:06.965434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: WARNING py.warnings [None req-34c14d47-bbd0-45af-91d1-d25d373c4b7f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:06.965434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: warnings.warn(msg) Jul 21 04:18:06.965434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: Jul 21 04:18:06.966865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c14d47-bbd0-45af-91d1-d25d373c4b7f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:06.969268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-4a1c2136-0c79-4e29-a002-8b38013360a8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:06.970623 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4a1c2136-0c79-4e29-a002-8b38013360a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:06.979318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 770/1550] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:06.980662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b77e5f-2f37-4690-963f-48a49d83b09c None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.980943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b77e5f-2f37-4690-963f-48a49d83b09c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.981216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b77e5f-2f37-4690-963f-48a49d83b09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:06.997762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 781/1551] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/users => generated 293 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:06.997762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf5b7b-94c4-4ccb-802a-cdd8a55fa8f0 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:06.997762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf5b7b-94c4-4ccb-802a-cdd8a55fa8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:06.997762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf5b7b-94c4-4ccb-802a-cdd8a55fa8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.002689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-06b77e5f-2f37-4690-963f-48a49d83b09c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.004842 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-06b77e5f-2f37-4690-963f-48a49d83b09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.012901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 771/1552] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.013669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b77e5f-2f37-4690-963f-48a49d83b09c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.015891 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-31bf5b7b-94c4-4ccb-802a-cdd8a55fa8f0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.017079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-31bf5b7b-94c4-4ccb-802a-cdd8a55fa8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.024153 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b77e5f-2f37-4690-963f-48a49d83b09c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.027088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 782/1553] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.028404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77144-232b-4b0f-80b9-1c0d864da3e3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.028696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77144-232b-4b0f-80b9-1c0d864da3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.028869 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a7e9b-1dba-43e8-a539-25c1d9607154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.029082 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a77144-232b-4b0f-80b9-1c0d864da3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.029513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a7e9b-1dba-43e8-a539-25c1d9607154 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.029795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a7e9b-1dba-43e8-a539-25c1d9607154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.030069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a7e9b-1dba-43e8-a539-25c1d9607154 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.030757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a7e9b-1dba-43e8-a539-25c1d9607154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.032708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a7e9b-1dba-43e8-a539-25c1d9607154 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.054019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 772/1554] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/users => generated 290 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.055487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbece37-bdf9-468c-8370-d2382af3e9cc None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.055777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbece37-bdf9-468c-8370-d2382af3e9cc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.056056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbece37-bdf9-468c-8370-d2382af3e9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.057563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-01a77144-232b-4b0f-80b9-1c0d864da3e3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.058779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-01a77144-232b-4b0f-80b9-1c0d864da3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.067004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 783/1555] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.068746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a409d2-b3aa-44c4-a475-3ebddb7f34a0 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.069033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a409d2-b3aa-44c4-a475-3ebddb7f34a0 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.069302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a409d2-b3aa-44c4-a475-3ebddb7f34a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.076559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-efbece37-bdf9-468c-8370-d2382af3e9cc None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.077855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-efbece37-bdf9-468c-8370-d2382af3e9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.086490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 773/1556] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.087778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edcf67-9d29-45ec-a878-10a50e5e4efb None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.088061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edcf67-9d29-45ec-a878-10a50e5e4efb None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.088334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edcf67-9d29-45ec-a878-10a50e5e4efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.089266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-76a409d2-b3aa-44c4-a475-3ebddb7f34a0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.090462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-76a409d2-b3aa-44c4-a475-3ebddb7f34a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.099699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 784/1557] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.100906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a409d2-b3aa-44c4-a475-3ebddb7f34a0 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.105835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-f5edcf67-9d29-45ec-a878-10a50e5e4efb None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.107055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f5edcf67-9d29-45ec-a878-10a50e5e4efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.110982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a409d2-b3aa-44c4-a475-3ebddb7f34a0 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.115286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 774/1558] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.116560 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac027dff-fd71-4b2a-9a41-3d81e30ca91b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.116850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac027dff-fd71-4b2a-9a41-3d81e30ca91b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.117130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac027dff-fd71-4b2a-9a41-3d81e30ca91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.119333 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ca55be-34a1-479c-bad2-33b83f9575f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.120008 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca55be-34a1-479c-bad2-33b83f9575f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.120297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca55be-34a1-479c-bad2-33b83f9575f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.120579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ca55be-34a1-479c-bad2-33b83f9575f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.121313 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca55be-34a1-479c-bad2-33b83f9575f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.122931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ca55be-34a1-479c-bad2-33b83f9575f0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.133761 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 785/1559] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:07.134833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f35898-e4dc-410a-a3b8-1cb20d3b64db None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.134980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-ac027dff-fd71-4b2a-9a41-3d81e30ca91b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.135159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f35898-e4dc-410a-a3b8-1cb20d3b64db None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.135544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f35898-e4dc-410a-a3b8-1cb20d3b64db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.136125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ac027dff-fd71-4b2a-9a41-3d81e30ca91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.143920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 775/1560] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.144693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac027dff-fd71-4b2a-9a41-3d81e30ca91b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.153775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b6f35898-e4dc-410a-a3b8-1cb20d3b64db None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.154325 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac027dff-fd71-4b2a-9a41-3d81e30ca91b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.155003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b6f35898-e4dc-410a-a3b8-1cb20d3b64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.158825 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dec4f4-6069-40bb-9ea2-6f9925e16475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.159505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dec4f4-6069-40bb-9ea2-6f9925e16475 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.159792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dec4f4-6069-40bb-9ea2-6f9925e16475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.160070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dec4f4-6069-40bb-9ea2-6f9925e16475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.160788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dec4f4-6069-40bb-9ea2-6f9925e16475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.162424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dec4f4-6069-40bb-9ea2-6f9925e16475 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.162947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 786/1561] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.164168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38578da6-e9fb-400c-a34a-a39b55cdd187 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.164453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38578da6-e9fb-400c-a34a-a39b55cdd187 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.164726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38578da6-e9fb-400c-a34a-a39b55cdd187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.175733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 776/1562] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:07.175733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dec4f4-6069-40bb-9ea2-6f9925e16475 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.182849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-38578da6-e9fb-400c-a34a-a39b55cdd187 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.183865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dec4f4-6069-40bb-9ea2-6f9925e16475 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.184073 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-38578da6-e9fb-400c-a34a-a39b55cdd187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.188612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926e344-cf04-4c85-b0c3-977cacf48a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.189273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926e344-cf04-4c85-b0c3-977cacf48a14 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.189567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926e344-cf04-4c85-b0c3-977cacf48a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.190132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d926e344-cf04-4c85-b0c3-977cacf48a14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.190858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926e344-cf04-4c85-b0c3-977cacf48a14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:07.191202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926e344-cf04-4c85-b0c3-977cacf48a14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.193759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d926e344-cf04-4c85-b0c3-977cacf48a14 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.193971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 787/1563] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.196145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38578da6-e9fb-400c-a34a-a39b55cdd187 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.206374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 777/1564] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:07.207254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926e344-cf04-4c85-b0c3-977cacf48a14 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.209759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38578da6-e9fb-400c-a34a-a39b55cdd187 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.214795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288b069-f42f-4d9b-9b28-7c4cb7929c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.215486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288b069-f42f-4d9b-9b28-7c4cb7929c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.215766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288b069-f42f-4d9b-9b28-7c4cb7929c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.216037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288b069-f42f-4d9b-9b28-7c4cb7929c0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.216792 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288b069-f42f-4d9b-9b28-7c4cb7929c0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:07.217094 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288b069-f42f-4d9b-9b28-7c4cb7929c0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.217801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d926e344-cf04-4c85-b0c3-977cacf48a14 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.218732 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288b069-f42f-4d9b-9b28-7c4cb7929c0f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.222431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48c83-4e0a-4d04-9196-83e4ff843464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.223106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48c83-4e0a-4d04-9196-83e4ff843464 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.223396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48c83-4e0a-4d04-9196-83e4ff843464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.223674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf48c83-4e0a-4d04-9196-83e4ff843464 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.224623 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48c83-4e0a-4d04-9196-83e4ff843464 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:07.224736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48c83-4e0a-4d04-9196-83e4ff843464 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.226338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf48c83-4e0a-4d04-9196-83e4ff843464 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.231251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 788/1565] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:07.232130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288b069-f42f-4d9b-9b28-7c4cb7929c0f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.238911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 778/1566] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:07.239987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48c83-4e0a-4d04-9196-83e4ff843464 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.242996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288b069-f42f-4d9b-9b28-7c4cb7929c0f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.248531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107049bd-93f4-44c5-bd47-d0136e04f883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.249129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107049bd-93f4-44c5-bd47-d0136e04f883 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.249411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107049bd-93f4-44c5-bd47-d0136e04f883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.249685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107049bd-93f4-44c5-bd47-d0136e04f883 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.250403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107049bd-93f4-44c5-bd47-d0136e04f883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.252092 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107049bd-93f4-44c5-bd47-d0136e04f883 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.252717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf48c83-4e0a-4d04-9196-83e4ff843464 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.258060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f786853-9452-4bfd-a8a5-0fd8f2f1e792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.258701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f786853-9452-4bfd-a8a5-0fd8f2f1e792 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.259016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f786853-9452-4bfd-a8a5-0fd8f2f1e792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.259299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f786853-9452-4bfd-a8a5-0fd8f2f1e792 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.260025 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f786853-9452-4bfd-a8a5-0fd8f2f1e792 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:07.260334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f786853-9452-4bfd-a8a5-0fd8f2f1e792 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.261939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f786853-9452-4bfd-a8a5-0fd8f2f1e792 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.263421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 789/1567] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:07.264221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107049bd-93f4-44c5-bd47-d0136e04f883 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.282906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 779/1568] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:07.283260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107049bd-93f4-44c5-bd47-d0136e04f883 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.283410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f786853-9452-4bfd-a8a5-0fd8f2f1e792 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.283410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:07.287543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf97cb7-b2cf-4a4d-9df6-4b06a00ec409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.288409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf97cb7-b2cf-4a4d-9df6-4b06a00ec409 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.288655 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f786853-9452-4bfd-a8a5-0fd8f2f1e792 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.288783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf97cb7-b2cf-4a4d-9df6-4b06a00ec409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.289035 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf97cb7-b2cf-4a4d-9df6-4b06a00ec409 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.289772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf97cb7-b2cf-4a4d-9df6-4b06a00ec409 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:07.290088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf97cb7-b2cf-4a4d-9df6-4b06a00ec409 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.293786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c243-bbf2-4a36-bfa0-275a233a9d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.293950 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf97cb7-b2cf-4a4d-9df6-4b06a00ec409 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.294497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c243-bbf2-4a36-bfa0-275a233a9d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.294780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c243-bbf2-4a36-bfa0-275a233a9d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.295087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc2c243-bbf2-4a36-bfa0-275a233a9d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.295810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c243-bbf2-4a36-bfa0-275a233a9d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.297408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc2c243-bbf2-4a36-bfa0-275a233a9d65 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.306684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 790/1569] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:07.307613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf97cb7-b2cf-4a4d-9df6-4b06a00ec409 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.308482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 780/1570] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:07.311994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c243-bbf2-4a36-bfa0-275a233a9d65 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.314136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:07.320025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf97cb7-b2cf-4a4d-9df6-4b06a00ec409 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.325169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc2c243-bbf2-4a36-bfa0-275a233a9d65 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.325801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c84a92-fdf5-4a0d-b3d3-f6a6809fd1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.326477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c84a92-fdf5-4a0d-b3d3-f6a6809fd1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.326767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c84a92-fdf5-4a0d-b3d3-f6a6809fd1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.327087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c84a92-fdf5-4a0d-b3d3-f6a6809fd1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.327824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c84a92-fdf5-4a0d-b3d3-f6a6809fd1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:07.328134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c84a92-fdf5-4a0d-b3d3-f6a6809fd1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.329776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c84a92-fdf5-4a0d-b3d3-f6a6809fd1c0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.330099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b7dc9-58ec-4fa5-a8a0-39696c8489c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.330771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7dc9-58ec-4fa5-a8a0-39696c8489c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.331094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7dc9-58ec-4fa5-a8a0-39696c8489c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.331509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b7dc9-58ec-4fa5-a8a0-39696c8489c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.332108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b7dc9-58ec-4fa5-a8a0-39696c8489c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.334085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b7dc9-58ec-4fa5-a8a0-39696c8489c5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.343007 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 791/1571] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:07.343837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c84a92-fdf5-4a0d-b3d3-f6a6809fd1c0 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.353969 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c84a92-fdf5-4a0d-b3d3-f6a6809fd1c0 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.359302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789ca4c-0abb-4a51-b3d7-74969f904f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.359952 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789ca4c-0abb-4a51-b3d7-74969f904f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.360241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789ca4c-0abb-4a51-b3d7-74969f904f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.360510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789ca4c-0abb-4a51-b3d7-74969f904f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.361198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789ca4c-0abb-4a51-b3d7-74969f904f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.363126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4789ca4c-0abb-4a51-b3d7-74969f904f5c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.365445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 781/1572] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/projects => generated 393 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.369555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b7dc9-58ec-4fa5-a8a0-39696c8489c5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.390063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 792/1573] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.390864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789ca4c-0abb-4a51-b3d7-74969f904f5c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.434915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b7dc9-58ec-4fa5-a8a0-39696c8489c5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.452254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789ca4c-0abb-4a51-b3d7-74969f904f5c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.457281 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e34be-74d3-440b-bb36-a13cb77f5545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.458200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e34be-74d3-440b-bb36-a13cb77f5545 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.458623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e34be-74d3-440b-bb36-a13cb77f5545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.458904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e34be-74d3-440b-bb36-a13cb77f5545 admin admin] PATH_INFO: `/v3/projects/801e3cfb6ca74f2b94946e52d60b5854/users/94d0ed0857064f368e9f09b434bf93fa/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.473088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e34be-74d3-440b-bb36-a13cb77f5545 admin admin] RBAC: Authorizing `identity:create_grant(project_id=801e3cfb6ca74f2b94946e52d60b5854, user_id=94d0ed0857064f368e9f09b434bf93fa, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.476152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e34be-74d3-440b-bb36-a13cb77f5545 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.490126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 793/1574] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:07 2022] PUT /identity/v3/projects/801e3cfb6ca74f2b94946e52d60b5854/users/94d0ed0857064f368e9f09b434bf93fa/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:07.491098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e34be-74d3-440b-bb36-a13cb77f5545 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.491443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa2f7e-1162-44e2-ab8c-9a92d32b8cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.492104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa2f7e-1162-44e2-ab8c-9a92d32b8cae admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.492404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa2f7e-1162-44e2-ab8c-9a92d32b8cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.492705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa2f7e-1162-44e2-ab8c-9a92d32b8cae admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.493354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa2f7e-1162-44e2-ab8c-9a92d32b8cae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.495738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa2f7e-1162-44e2-ab8c-9a92d32b8cae admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.524881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 782/1575] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/projects => generated 403 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.525811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa2f7e-1162-44e2-ab8c-9a92d32b8cae admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.554910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e34be-74d3-440b-bb36-a13cb77f5545 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.588616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa2f7e-1162-44e2-ab8c-9a92d32b8cae admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.593482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930bac5-e02b-4b4e-855b-9045831772eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.594452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930bac5-e02b-4b4e-855b-9045831772eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.594752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930bac5-e02b-4b4e-855b-9045831772eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.595131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930bac5-e02b-4b4e-855b-9045831772eb admin admin] PATH_INFO: `/v3/projects/0214c9fd0c94412ab2741d8685bce7ed/users/eed183b5cd59420da43e87788fd39051/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.598162 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:07.611396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930bac5-e02b-4b4e-855b-9045831772eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0214c9fd0c94412ab2741d8685bce7ed, user_id=eed183b5cd59420da43e87788fd39051, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.612737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WARNING py.warnings [None req-2930bac5-e02b-4b4e-855b-9045831772eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:07.612737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: warnings.warn(msg) Jul 21 04:18:07.612737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: Jul 21 04:18:07.613776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab18cd7-840a-490b-8719-1b48a2d28288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.614441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab18cd7-840a-490b-8719-1b48a2d28288 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.615266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab18cd7-840a-490b-8719-1b48a2d28288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.615579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab18cd7-840a-490b-8719-1b48a2d28288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.615804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930bac5-e02b-4b4e-855b-9045831772eb admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.616241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab18cd7-840a-490b-8719-1b48a2d28288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.618146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab18cd7-840a-490b-8719-1b48a2d28288 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.622190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:07.629898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 783/1576] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:07 2022] PUT /identity/v3/projects/0214c9fd0c94412ab2741d8685bce7ed/users/eed183b5cd59420da43e87788fd39051/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:07.631572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930bac5-e02b-4b4e-855b-9045831772eb admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.649568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 794/1577] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.650361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab18cd7-840a-490b-8719-1b48a2d28288 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.696660 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930bac5-e02b-4b4e-855b-9045831772eb admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.713589 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab18cd7-840a-490b-8719-1b48a2d28288 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.718205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d7bed-b0f6-48ef-86cd-9cbd3b5fcd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.718865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7bed-b0f6-48ef-86cd-9cbd3b5fcd0c admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.719181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7bed-b0f6-48ef-86cd-9cbd3b5fcd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.719469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d7bed-b0f6-48ef-86cd-9cbd3b5fcd0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.720163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d7bed-b0f6-48ef-86cd-9cbd3b5fcd0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.722095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d7bed-b0f6-48ef-86cd-9cbd3b5fcd0c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.758335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 795/1578] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/projects => generated 373 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.758566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ddb9c-2118-4e05-b98e-45720df94c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.758693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d7bed-b0f6-48ef-86cd-9cbd3b5fcd0c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.758814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ddb9c-2118-4e05-b98e-45720df94c7e admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.758814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ddb9c-2118-4e05-b98e-45720df94c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.758814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ddb9c-2118-4e05-b98e-45720df94c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.758814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ddb9c-2118-4e05-b98e-45720df94c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.759592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ddb9c-2118-4e05-b98e-45720df94c7e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.788880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 784/1579] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/projects => generated 371 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.788880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ddb9c-2118-4e05-b98e-45720df94c7e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.826916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d7bed-b0f6-48ef-86cd-9cbd3b5fcd0c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.847551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ddb9c-2118-4e05-b98e-45720df94c7e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.852720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31a6a0-7bda-4da8-a866-e979ef41848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.853388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31a6a0-7bda-4da8-a866-e979ef41848f admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.853675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31a6a0-7bda-4da8-a866-e979ef41848f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.853948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31a6a0-7bda-4da8-a866-e979ef41848f admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.854630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31a6a0-7bda-4da8-a866-e979ef41848f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.856600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31a6a0-7bda-4da8-a866-e979ef41848f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.881506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 785/1580] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.883841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820514f1-85a2-4448-b110-eeb5db3c3010 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.884344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820514f1-85a2-4448-b110-eeb5db3c3010 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.884819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820514f1-85a2-4448-b110-eeb5db3c3010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.885287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f6646-77a6-427a-a94c-44925568ee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.886282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f6646-77a6-427a-a94c-44925568ee7e admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.886422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f6646-77a6-427a-a94c-44925568ee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.886711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07f6646-77a6-427a-a94c-44925568ee7e admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.887445 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f6646-77a6-427a-a94c-44925568ee7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.889380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07f6646-77a6-427a-a94c-44925568ee7e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.898404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:07.904112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-820514f1-85a2-4448-b110-eeb5db3c3010 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.905887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-820514f1-85a2-4448-b110-eeb5db3c3010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.913252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 796/1581] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/users => generated 297 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.913252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f6646-77a6-427a-a94c-44925568ee7e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.918590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 786/1582] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.920125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877987f-0f4c-4c9a-a814-ba0a5e8e4de6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.920412 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877987f-0f4c-4c9a-a814-ba0a5e8e4de6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.920686 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1877987f-0f4c-4c9a-a814-ba0a5e8e4de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.920798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07f6646-77a6-427a-a94c-44925568ee7e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.925954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29ae89-17f5-4874-ba4a-e7d2a5c322fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.926627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ae89-17f5-4874-ba4a-e7d2a5c322fe admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.927762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ae89-17f5-4874-ba4a-e7d2a5c322fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.927894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29ae89-17f5-4874-ba4a-e7d2a5c322fe admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.928539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29ae89-17f5-4874-ba4a-e7d2a5c322fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.930592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe29ae89-17f5-4874-ba4a-e7d2a5c322fe admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.937542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:07.938715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1877987f-0f4c-4c9a-a814-ba0a5e8e4de6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:07.940243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1877987f-0f4c-4c9a-a814-ba0a5e8e4de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:07.949821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 787/1583] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:07.950729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877987f-0f4c-4c9a-a814-ba0a5e8e4de6 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.955549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 797/1584] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/users => generated 302 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.956416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29ae89-17f5-4874-ba4a-e7d2a5c322fe admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.960766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1877987f-0f4c-4c9a-a814-ba0a5e8e4de6 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.965366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08de3d0-65dc-4d1b-962b-c8537b62251b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.966030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08de3d0-65dc-4d1b-962b-c8537b62251b admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.966312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08de3d0-65dc-4d1b-962b-c8537b62251b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.966583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08de3d0-65dc-4d1b-962b-c8537b62251b admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.967322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08de3d0-65dc-4d1b-962b-c8537b62251b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.968669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29ae89-17f5-4874-ba4a-e7d2a5c322fe admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:07.969228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08de3d0-65dc-4d1b-962b-c8537b62251b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.973541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0dd31-3687-4f2b-9520-3c466a59fe53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:07.974727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0dd31-3687-4f2b-9520-3c466a59fe53 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:07.975044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0dd31-3687-4f2b-9520-3c466a59fe53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:07.975326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0dd31-3687-4f2b-9520-3c466a59fe53 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:07.976013 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0dd31-3687-4f2b-9520-3c466a59fe53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:07.977959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0dd31-3687-4f2b-9520-3c466a59fe53 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:07.990998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 788/1585] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/users => generated 293 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:07.991893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08de3d0-65dc-4d1b-962b-c8537b62251b admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:07.999515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 798/1586] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/users => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:08.000405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0dd31-3687-4f2b-9520-3c466a59fe53 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.001997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08de3d0-65dc-4d1b-962b-c8537b62251b admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.006850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1f47a-e151-4abe-8284-42b2ac52fc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.007540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1f47a-e151-4abe-8284-42b2ac52fc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.007826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1f47a-e151-4abe-8284-42b2ac52fc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.008101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1f47a-e151-4abe-8284-42b2ac52fc54 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.008812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1f47a-e151-4abe-8284-42b2ac52fc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.010502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0dd31-3687-4f2b-9520-3c466a59fe53 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.010732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1f47a-e151-4abe-8284-42b2ac52fc54 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.015092 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478149a-6463-4a03-97a2-eaf09616532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.015737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478149a-6463-4a03-97a2-eaf09616532e admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.016028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478149a-6463-4a03-97a2-eaf09616532e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.016309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478149a-6463-4a03-97a2-eaf09616532e admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.017031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478149a-6463-4a03-97a2-eaf09616532e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.018633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478149a-6463-4a03-97a2-eaf09616532e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.030265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 799/1587] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.031254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478149a-6463-4a03-97a2-eaf09616532e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.037212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 789/1588] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:07 2022] POST /identity/v3/users => generated 286 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:08.037212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1f47a-e151-4abe-8284-42b2ac52fc54 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.042070 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478149a-6463-4a03-97a2-eaf09616532e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.046623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cb41c-bf98-4b13-b369-a57c53237baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.047302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cb41c-bf98-4b13-b369-a57c53237baf admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.047590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cb41c-bf98-4b13-b369-a57c53237baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.047870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55cb41c-bf98-4b13-b369-a57c53237baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.048619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cb41c-bf98-4b13-b369-a57c53237baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.050231 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55cb41c-bf98-4b13-b369-a57c53237baf admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.061426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 800/1589] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.062389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cb41c-bf98-4b13-b369-a57c53237baf admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.072624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55cb41c-bf98-4b13-b369-a57c53237baf admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.077193 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a1265-fb0c-49fa-b930-1c680fd74650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.077836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a1265-fb0c-49fa-b930-1c680fd74650 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.078436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a1265-fb0c-49fa-b930-1c680fd74650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.078436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a1265-fb0c-49fa-b930-1c680fd74650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.079132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a1265-fb0c-49fa-b930-1c680fd74650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.080817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a1265-fb0c-49fa-b930-1c680fd74650 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.091577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 801/1590] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.092552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a1265-fb0c-49fa-b930-1c680fd74650 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.092872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1f47a-e151-4abe-8284-42b2ac52fc54 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.096763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8e216-2f32-49de-a196-44cc28262405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.097412 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8e216-2f32-49de-a196-44cc28262405 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.097698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8e216-2f32-49de-a196-44cc28262405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.097977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8e216-2f32-49de-a196-44cc28262405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.102576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a1265-fb0c-49fa-b930-1c680fd74650 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.106181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addf3c2-6b21-481a-9b9e-d6fab6340261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.106790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addf3c2-6b21-481a-9b9e-d6fab6340261 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.107134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addf3c2-6b21-481a-9b9e-d6fab6340261 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.107381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addf3c2-6b21-481a-9b9e-d6fab6340261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.108100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8e216-2f32-49de-a196-44cc28262405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.109589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c8e216-2f32-49de-a196-44cc28262405 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.116562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addf3c2-6b21-481a-9b9e-d6fab6340261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.117985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addf3c2-6b21-481a-9b9e-d6fab6340261 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.119814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 790/1591] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:08.127878 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8e216-2f32-49de-a196-44cc28262405 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.128456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 802/1592] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:08.129296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addf3c2-6b21-481a-9b9e-d6fab6340261 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.138022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8e216-2f32-49de-a196-44cc28262405 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.138705 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addf3c2-6b21-481a-9b9e-d6fab6340261 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.143289 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056192b9-cc9d-44aa-9956-4edacd0d4d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.143438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea201bec-98ac-4e9a-b993-0305cfbad1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.143950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056192b9-cc9d-44aa-9956-4edacd0d4d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.144070 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201bec-98ac-4e9a-b993-0305cfbad1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.144239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056192b9-cc9d-44aa-9956-4edacd0d4d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.144340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201bec-98ac-4e9a-b993-0305cfbad1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.144516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056192b9-cc9d-44aa-9956-4edacd0d4d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.144615 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea201bec-98ac-4e9a-b993-0305cfbad1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.145209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056192b9-cc9d-44aa-9956-4edacd0d4d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.145337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea201bec-98ac-4e9a-b993-0305cfbad1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.147355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea201bec-98ac-4e9a-b993-0305cfbad1f9 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.147695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056192b9-cc9d-44aa-9956-4edacd0d4d58 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.160363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 791/1593] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.161014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056192b9-cc9d-44aa-9956-4edacd0d4d58 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.164066 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 803/1594] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.165643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea201bec-98ac-4e9a-b993-0305cfbad1f9 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.171862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056192b9-cc9d-44aa-9956-4edacd0d4d58 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.178105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e3268-42a5-40b2-af7c-117b08583b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.179023 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e3268-42a5-40b2-af7c-117b08583b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.179480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea201bec-98ac-4e9a-b993-0305cfbad1f9 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.183273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e3268-42a5-40b2-af7c-117b08583b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.183759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e3268-42a5-40b2-af7c-117b08583b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.184685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406b8d3-059b-4b58-849d-727123bde193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.185545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406b8d3-059b-4b58-849d-727123bde193 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.185749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e3268-42a5-40b2-af7c-117b08583b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.185914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406b8d3-059b-4b58-849d-727123bde193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.186105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406b8d3-059b-4b58-849d-727123bde193 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.186836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406b8d3-059b-4b58-849d-727123bde193 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.187558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e3268-42a5-40b2-af7c-117b08583b21 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.188497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406b8d3-059b-4b58-849d-727123bde193 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.199733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 792/1595] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.203336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e3268-42a5-40b2-af7c-117b08583b21 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.203468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 804/1596] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.203468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406b8d3-059b-4b58-849d-727123bde193 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.214041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e3268-42a5-40b2-af7c-117b08583b21 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.217234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406b8d3-059b-4b58-849d-727123bde193 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.219244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5f836-92c8-4dc2-a504-93b1a11a94d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.219861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5f836-92c8-4dc2-a504-93b1a11a94d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.220203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5f836-92c8-4dc2-a504-93b1a11a94d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.220411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5f836-92c8-4dc2-a504-93b1a11a94d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.221138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5f836-92c8-4dc2-a504-93b1a11a94d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.222736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5f836-92c8-4dc2-a504-93b1a11a94d9 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.224603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f99c7-843e-4ac4-98b2-28cf3cf6b063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.225302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f99c7-843e-4ac4-98b2-28cf3cf6b063 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.225588 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f99c7-843e-4ac4-98b2-28cf3cf6b063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.225866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f99c7-843e-4ac4-98b2-28cf3cf6b063 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.226606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f99c7-843e-4ac4-98b2-28cf3cf6b063 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.228656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f99c7-843e-4ac4-98b2-28cf3cf6b063 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.235645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 793/1597] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.236585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5f836-92c8-4dc2-a504-93b1a11a94d9 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.244674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 805/1598] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.248122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f99c7-843e-4ac4-98b2-28cf3cf6b063 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.251048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5f836-92c8-4dc2-a504-93b1a11a94d9 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.256223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d433c-e058-4ed3-b511-27d4e6f9ed78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.256913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d433c-e058-4ed3-b511-27d4e6f9ed78 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.257183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f99c7-843e-4ac4-98b2-28cf3cf6b063 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.257300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d433c-e058-4ed3-b511-27d4e6f9ed78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.257459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d433c-e058-4ed3-b511-27d4e6f9ed78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.258187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d433c-e058-4ed3-b511-27d4e6f9ed78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.259839 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64d433c-e058-4ed3-b511-27d4e6f9ed78 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.262306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb8487-c9cf-4e72-8194-f2aeff827c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.262911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb8487-c9cf-4e72-8194-f2aeff827c49 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.263248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb8487-c9cf-4e72-8194-f2aeff827c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.263527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabb8487-c9cf-4e72-8194-f2aeff827c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.264270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb8487-c9cf-4e72-8194-f2aeff827c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.266306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabb8487-c9cf-4e72-8194-f2aeff827c49 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.277112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 794/1599] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.277112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d433c-e058-4ed3-b511-27d4e6f9ed78 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.284349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 806/1600] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.284889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb8487-c9cf-4e72-8194-f2aeff827c49 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.291593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d433c-e058-4ed3-b511-27d4e6f9ed78 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.296796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a3b79-a741-48c3-8166-734bda6475e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.297239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabb8487-c9cf-4e72-8194-f2aeff827c49 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.297993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a3b79-a741-48c3-8166-734bda6475e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.298365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a3b79-a741-48c3-8166-734bda6475e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.298739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a3b79-a741-48c3-8166-734bda6475e4 admin admin] PATH_INFO: `/v3/projects/4a8d9717833e4f8fab5a7a99c6fc79cf/users/a07422882b254a0596ef1032c04ab770/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.303802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf8588-12b2-4881-8168-6260e6ea27dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.304552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf8588-12b2-4881-8168-6260e6ea27dc admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.304952 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf8588-12b2-4881-8168-6260e6ea27dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.305177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf8588-12b2-4881-8168-6260e6ea27dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.305907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf8588-12b2-4881-8168-6260e6ea27dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.307684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf8588-12b2-4881-8168-6260e6ea27dc admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.319728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 807/1601] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:08.320479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf8588-12b2-4881-8168-6260e6ea27dc admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.326747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a3b79-a741-48c3-8166-734bda6475e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a8d9717833e4f8fab5a7a99c6fc79cf, user_id=a07422882b254a0596ef1032c04ab770, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.330882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483a3b79-a741-48c3-8166-734bda6475e4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.331278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf8588-12b2-4881-8168-6260e6ea27dc admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.337788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702d192-0b1f-4dab-b126-e62109114bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.338727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702d192-0b1f-4dab-b126-e62109114bfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.339053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702d192-0b1f-4dab-b126-e62109114bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.339368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702d192-0b1f-4dab-b126-e62109114bfc admin admin] PATH_INFO: `/v3/projects/b8ba79f7b1fd43a298d56a2396ecf3d6/users/9b6716c39cc74e3c8b3949773023c2f5/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.348442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 795/1602] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:08 2022] PUT /identity/v3/projects/4a8d9717833e4f8fab5a7a99c6fc79cf/users/a07422882b254a0596ef1032c04ab770/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:08.350732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a3b79-a741-48c3-8166-734bda6475e4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.370479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702d192-0b1f-4dab-b126-e62109114bfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ba79f7b1fd43a298d56a2396ecf3d6, user_id=9b6716c39cc74e3c8b3949773023c2f5, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.373465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702d192-0b1f-4dab-b126-e62109114bfc admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.390420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 808/1603] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:08 2022] PUT /identity/v3/projects/b8ba79f7b1fd43a298d56a2396ecf3d6/users/9b6716c39cc74e3c8b3949773023c2f5/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:08.391247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702d192-0b1f-4dab-b126-e62109114bfc admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.428451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:08.444909 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a3b79-a741-48c3-8166-734bda6475e4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.473231 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702d192-0b1f-4dab-b126-e62109114bfc admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.479466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc703a27-2bd3-4078-9af2-fdbce0edd568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.480501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc703a27-2bd3-4078-9af2-fdbce0edd568 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.480865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc703a27-2bd3-4078-9af2-fdbce0edd568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.481244 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc703a27-2bd3-4078-9af2-fdbce0edd568 admin admin] PATH_INFO: `/v3/projects/0a0d880e4a9d4255a969d295dfd8e0ac/users/a0edea9c9a3946c880a7231aa9ce2325/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.494521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:08.501104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc703a27-2bd3-4078-9af2-fdbce0edd568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a0d880e4a9d4255a969d295dfd8e0ac, user_id=a0edea9c9a3946c880a7231aa9ce2325, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.504809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc703a27-2bd3-4078-9af2-fdbce0edd568 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.519283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f175-9385-4966-8496-55dd3c3f4e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.522357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f175-9385-4966-8496-55dd3c3f4e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.522902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f175-9385-4966-8496-55dd3c3f4e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.523319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f950f175-9385-4966-8496-55dd3c3f4e63 admin admin] PATH_INFO: `/v3/projects/e26c92030a3c47a8a3ccbc17dba9ff7f/users/a708560af176421a91b75ce87574d77d/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.526559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 809/1604] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:08 2022] PUT /identity/v3/projects/0a0d880e4a9d4255a969d295dfd8e0ac/users/a0edea9c9a3946c880a7231aa9ce2325/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:08.527612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc703a27-2bd3-4078-9af2-fdbce0edd568 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.543866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950f175-9385-4966-8496-55dd3c3f4e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26c92030a3c47a8a3ccbc17dba9ff7f, user_id=a708560af176421a91b75ce87574d77d, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.559964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f950f175-9385-4966-8496-55dd3c3f4e63 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.598455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 796/1605] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:08 2022] PUT /identity/v3/projects/e26c92030a3c47a8a3ccbc17dba9ff7f/users/a708560af176421a91b75ce87574d77d/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:08.600447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f175-9385-4966-8496-55dd3c3f4e63 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:08.628454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc703a27-2bd3-4078-9af2-fdbce0edd568 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.697230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c373aa45-24a2-40f0-9622-76c04e1ee391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.698767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373aa45-24a2-40f0-9622-76c04e1ee391 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.698767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373aa45-24a2-40f0-9622-76c04e1ee391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.699656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c373aa45-24a2-40f0-9622-76c04e1ee391 admin admin] PATH_INFO: `/v3/projects/b76d29ad436b46b9a2c347aa3920b887/users/74223bc5167f4e76a7361537368b4ac9/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.724508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f950f175-9385-4966-8496-55dd3c3f4e63 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:08.730394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373aa45-24a2-40f0-9622-76c04e1ee391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b76d29ad436b46b9a2c347aa3920b887, user_id=74223bc5167f4e76a7361537368b4ac9, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.731606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd664d2a-8839-4355-84b2-d7b81c8c2393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:08.733229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd664d2a-8839-4355-84b2-d7b81c8c2393 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.733597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c373aa45-24a2-40f0-9622-76c04e1ee391 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.733888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd664d2a-8839-4355-84b2-d7b81c8c2393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.734236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd664d2a-8839-4355-84b2-d7b81c8c2393 admin admin] PATH_INFO: `/v3/projects/eca79e52900d4581b0ef33007ba4d17d/users/8edd97611843497eb8051646dc456b2f/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.752965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 810/1606] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:08 2022] PUT /identity/v3/projects/b76d29ad436b46b9a2c347aa3920b887/users/74223bc5167f4e76a7361537368b4ac9/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:08.754343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cdfa2-0098-4e1b-8e5f-e1c2e253d503 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.754640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cdfa2-0098-4e1b-8e5f-e1c2e253d503 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.755162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07cdfa2-0098-4e1b-8e5f-e1c2e253d503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.770117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd664d2a-8839-4355-84b2-d7b81c8c2393 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eca79e52900d4581b0ef33007ba4d17d, user_id=8edd97611843497eb8051646dc456b2f, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:08.771725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd664d2a-8839-4355-84b2-d7b81c8c2393 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:08.789187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 797/1607] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:08 2022] PUT /identity/v3/projects/eca79e52900d4581b0ef33007ba4d17d/users/8edd97611843497eb8051646dc456b2f/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:08.790870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b956ee-3b33-438c-93f6-6cdb938b20a5 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.791359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b956ee-3b33-438c-93f6-6cdb938b20a5 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.791828 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b956ee-3b33-438c-93f6-6cdb938b20a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.803847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-f07cdfa2-0098-4e1b-8e5f-e1c2e253d503 None None] MFA Rules not processed for user `a07422882b254a0596ef1032c04ab770`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:08.805009 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f07cdfa2-0098-4e1b-8e5f-e1c2e253d503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:08.813417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-58b956ee-3b33-438c-93f6-6cdb938b20a5 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:08.815101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-58b956ee-3b33-438c-93f6-6cdb938b20a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:08.890783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 811/1608] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:08.893201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c3dba-9fa3-4547-bde8-f09d1fdb4e51 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.893793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c3dba-9fa3-4547-bde8-f09d1fdb4e51 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.894366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272c3dba-9fa3-4547-bde8-f09d1fdb4e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.919556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:08.935030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-272c3dba-9fa3-4547-bde8-f09d1fdb4e51 None None] MFA Rules not processed for user `a0edea9c9a3946c880a7231aa9ce2325`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:08.936671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-272c3dba-9fa3-4547-bde8-f09d1fdb4e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:08.958485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 798/1609] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:08.960448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3860b-9a41-40b7-81d9-df0ff59cda4b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:08.960832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3860b-9a41-40b7-81d9-df0ff59cda4b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:08.961037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3860b-9a41-40b7-81d9-df0ff59cda4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:08.987057 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:09.015235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-75c3860b-9a41-40b7-81d9-df0ff59cda4b None None] MFA Rules not processed for user `a708560af176421a91b75ce87574d77d`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:09.016988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-75c3860b-9a41-40b7-81d9-df0ff59cda4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:09.084386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 812/1610] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:09.087146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0debfbf-bb70-4cdd-bf55-0227bd623ea5 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.088689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0debfbf-bb70-4cdd-bf55-0227bd623ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.089083 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0debfbf-bb70-4cdd-bf55-0227bd623ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.110732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 799/1611] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:09.112689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2441ac-f8bf-496b-9b65-c20fcea7e7d1 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.113072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2441ac-f8bf-496b-9b65-c20fcea7e7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.113527 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2441ac-f8bf-496b-9b65-c20fcea7e7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.150053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a0debfbf-bb70-4cdd-bf55-0227bd623ea5 None None] MFA Rules not processed for user `74223bc5167f4e76a7361537368b4ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:09.155211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a0debfbf-bb70-4cdd-bf55-0227bd623ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:09.161995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-0a2441ac-f8bf-496b-9b65-c20fcea7e7d1 None None] MFA Rules not processed for user `8edd97611843497eb8051646dc456b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:09.163513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0a2441ac-f8bf-496b-9b65-c20fcea7e7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:09.271678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 800/1612] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:09.274205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc9b5-8c34-43b3-b9b3-210995b982ce None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.275088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc9b5-8c34-43b3-b9b3-210995b982ce None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.275825 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc9b5-8c34-43b3-b9b3-210995b982ce None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.283588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 801/1613] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jul 21 04:18:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:09.284809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc9b5-8c34-43b3-b9b3-210995b982ce None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.324717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 813/1614] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:09.325821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0debfbf-bb70-4cdd-bf55-0227bd623ea5 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.351990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0debfbf-bb70-4cdd-bf55-0227bd623ea5 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.362507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb1301-33c9-4bef-b43f-71bac4c4cd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.364365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb1301-33c9-4bef-b43f-71bac4c4cd3c admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.364847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb1301-33c9-4bef-b43f-71bac4c4cd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.365225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb1301-33c9-4bef-b43f-71bac4c4cd3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.366035 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb1301-33c9-4bef-b43f-71bac4c4cd3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.368553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb1301-33c9-4bef-b43f-71bac4c4cd3c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.392564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc9b5-8c34-43b3-b9b3-210995b982ce None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.397861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c8049-0998-4515-8cf2-4035dc49446d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.398718 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c8049-0998-4515-8cf2-4035dc49446d service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.399082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c8049-0998-4515-8cf2-4035dc49446d service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.399359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c8049-0998-4515-8cf2-4035dc49446d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.411473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 814/1615] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/projects => generated 403 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:09.416311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdce0-4d94-4251-a924-9e9e3c31015b None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.416602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdce0-4d94-4251-a924-9e9e3c31015b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.416882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479fdce0-4d94-4251-a924-9e9e3c31015b None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.426999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 815/1616] 10.222.0.48 () {54 vars in 962 bytes} [Thu Jul 21 04:18:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:09.426999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fdce0-4d94-4251-a924-9e9e3c31015b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.427439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c8049-0998-4515-8cf2-4035dc49446d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.430463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572c8049-0998-4515-8cf2-4035dc49446d service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.454736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 802/1617] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:09.464976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dbfe1-ae29-4638-ab9f-130f4a09c79c None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.465663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dbfe1-ae29-4638-ab9f-130f4a09c79c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.466277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dbfe1-ae29-4638-ab9f-130f4a09c79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.531730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d92dbfe1-ae29-4638-ab9f-130f4a09c79c None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:09.535212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d92dbfe1-ae29-4638-ab9f-130f4a09c79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:09.549759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:09.573432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479fdce0-4d94-4251-a924-9e9e3c31015b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.582771 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965c293f-036f-42c9-9ad4-c62a764a3ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.584233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c293f-036f-42c9-9ad4-c62a764a3ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.584768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c293f-036f-42c9-9ad4-c62a764a3ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.585245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965c293f-036f-42c9-9ad4-c62a764a3ec4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.586194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c293f-036f-42c9-9ad4-c62a764a3ec4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.590572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965c293f-036f-42c9-9ad4-c62a764a3ec4 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.619668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:09.629407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 803/1618] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:09.631702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dbfe1-ae29-4638-ab9f-130f4a09c79c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.645396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dbfe1-ae29-4638-ab9f-130f4a09c79c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.646798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 816/1619] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/projects => generated 369 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:09.648982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deca5b-7624-464e-8c1c-0340b9ca8e5b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.649275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deca5b-7624-464e-8c1c-0340b9ca8e5b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.649596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03deca5b-7624-464e-8c1c-0340b9ca8e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.671216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-03deca5b-7624-464e-8c1c-0340b9ca8e5b None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:09.672527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-03deca5b-7624-464e-8c1c-0340b9ca8e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:09.710615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebff28-7529-4f95-80c0-7c971150dc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.711373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebff28-7529-4f95-80c0-7c971150dc62 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.711663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebff28-7529-4f95-80c0-7c971150dc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.711945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeebff28-7529-4f95-80c0-7c971150dc62 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.712643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebff28-7529-4f95-80c0-7c971150dc62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.714753 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeebff28-7529-4f95-80c0-7c971150dc62 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.744475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 804/1620] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/users => generated 308 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:09.746132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebff28-7529-4f95-80c0-7c971150dc62 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.760456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 817/1621] 10.222.0.48 () {58 vars in 1059 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:09.761416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03deca5b-7624-464e-8c1c-0340b9ca8e5b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.775832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03deca5b-7624-464e-8c1c-0340b9ca8e5b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.782735 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdf12a-3263-4acf-9101-2dd0abce3ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.783517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf12a-3263-4acf-9101-2dd0abce3ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.783850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf12a-3263-4acf-9101-2dd0abce3ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.784126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdf12a-3263-4acf-9101-2dd0abce3ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.784870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdf12a-3263-4acf-9101-2dd0abce3ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.788062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdf12a-3263-4acf-9101-2dd0abce3ef5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.819054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 818/1622] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:09 2022] POST /identity/v3/users => generated 291 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:09.819985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdf12a-3263-4acf-9101-2dd0abce3ef5 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.835354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdf12a-3263-4acf-9101-2dd0abce3ef5 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.841348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a93fb-d999-47fd-a2d7-418028e745a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.841894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeebff28-7529-4f95-80c0-7c971150dc62 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.842099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a93fb-d999-47fd-a2d7-418028e745a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.842595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a93fb-d999-47fd-a2d7-418028e745a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.842864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8a93fb-d999-47fd-a2d7-418028e745a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.843691 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a93fb-d999-47fd-a2d7-418028e745a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.845915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8a93fb-d999-47fd-a2d7-418028e745a3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.849504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3a674-e6eb-4d8e-aa03-4558126c1bb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.850532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a674-e6eb-4d8e-aa03-4558126c1bb3 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.850995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a674-e6eb-4d8e-aa03-4558126c1bb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.851581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3a674-e6eb-4d8e-aa03-4558126c1bb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.864365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 819/1623] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:09.865330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a93fb-d999-47fd-a2d7-418028e745a3 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.881538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8a93fb-d999-47fd-a2d7-418028e745a3 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.888906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cad9fe-5397-4cf0-8316-7f4321d1dc41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.889565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cad9fe-5397-4cf0-8316-7f4321d1dc41 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.889900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cad9fe-5397-4cf0-8316-7f4321d1dc41 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.890645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cad9fe-5397-4cf0-8316-7f4321d1dc41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:09.893617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:09.923410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3a674-e6eb-4d8e-aa03-4558126c1bb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.925319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3a674-e6eb-4d8e-aa03-4558126c1bb3 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.949713 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 805/1624] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:09.950931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3a674-e6eb-4d8e-aa03-4558126c1bb3 service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.956818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cad9fe-5397-4cf0-8316-7f4321d1dc41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:09.959092 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cad9fe-5397-4cf0-8316-7f4321d1dc41 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:09.970736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 820/1625] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:09.971622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cad9fe-5397-4cf0-8316-7f4321d1dc41 service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:09.985656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cad9fe-5397-4cf0-8316-7f4321d1dc41 service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.987390 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3a674-e6eb-4d8e-aa03-4558126c1bb3 service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:09.992563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069abc7-ac26-4d57-a485-0a0f0d71c928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:09.993548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069abc7-ac26-4d57-a485-0a0f0d71c928 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:09.993871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069abc7-ac26-4d57-a485-0a0f0d71c928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:09.994682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7069abc7-ac26-4d57-a485-0a0f0d71c928 admin admin] PATH_INFO: `/v3/projects/b9efca5a8a504fe886d73b3f77bb3f13/users/3642711119da4189b03216d8350f34e4/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.006378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dbedf-fd6e-427a-9f9f-8951b61a0d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.007115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dbedf-fd6e-427a-9f9f-8951b61a0d80 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.007399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dbedf-fd6e-427a-9f9f-8951b61a0d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.007674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823dbedf-fd6e-427a-9f9f-8951b61a0d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.008405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dbedf-fd6e-427a-9f9f-8951b61a0d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.010066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823dbedf-fd6e-427a-9f9f-8951b61a0d80 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.014337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069abc7-ac26-4d57-a485-0a0f0d71c928 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9efca5a8a504fe886d73b3f77bb3f13, user_id=3642711119da4189b03216d8350f34e4, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.017379 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7069abc7-ac26-4d57-a485-0a0f0d71c928 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.043158 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 806/1626] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:10.044060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dbedf-fd6e-427a-9f9f-8951b61a0d80 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.050317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 821/1627] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:09 2022] PUT /identity/v3/projects/b9efca5a8a504fe886d73b3f77bb3f13/users/3642711119da4189b03216d8350f34e4/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:10.057959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069abc7-ac26-4d57-a485-0a0f0d71c928 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.065766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823dbedf-fd6e-427a-9f9f-8951b61a0d80 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.146240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:10.210054 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0cfe2-9f7c-4417-951e-f4a389edb5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.211006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0cfe2-9f7c-4417-951e-f4a389edb5f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.211261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0cfe2-9f7c-4417-951e-f4a389edb5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.211688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0cfe2-9f7c-4417-951e-f4a389edb5f5 admin admin] PATH_INFO: `/v3/projects/72e32fffa04745a99ec6808e5126cead/users/7582fbb3a93e44159d0bb41aac3a60de/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.247091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0cfe2-9f7c-4417-951e-f4a389edb5f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e32fffa04745a99ec6808e5126cead, user_id=7582fbb3a93e44159d0bb41aac3a60de, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.252768 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0cfe2-9f7c-4417-951e-f4a389edb5f5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.257683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7069abc7-ac26-4d57-a485-0a0f0d71c928 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.272318 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565f8f7-0743-41a2-b976-d491fa83b7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.273616 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f8f7-0743-41a2-b976-d491fa83b7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.274679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f8f7-0743-41a2-b976-d491fa83b7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.275326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f8f7-0743-41a2-b976-d491fa83b7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.276271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565f8f7-0743-41a2-b976-d491fa83b7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.280073 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565f8f7-0743-41a2-b976-d491fa83b7bd admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.283258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 807/1628] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:10 2022] PUT /identity/v3/projects/72e32fffa04745a99ec6808e5126cead/users/7582fbb3a93e44159d0bb41aac3a60de/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:10.285190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0cfe2-9f7c-4417-951e-f4a389edb5f5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.317674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 822/1629] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:10.318844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565f8f7-0743-41a2-b976-d491fa83b7bd admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.345627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565f8f7-0743-41a2-b976-d491fa83b7bd admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.425495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0cfe2-9f7c-4417-951e-f4a389edb5f5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.437030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c65ae8-0ce5-4739-a75d-48530ac5077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.440471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c65ae8-0ce5-4739-a75d-48530ac5077f admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.440471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c65ae8-0ce5-4739-a75d-48530ac5077f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.440471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c65ae8-0ce5-4739-a75d-48530ac5077f admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.440471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c65ae8-0ce5-4739-a75d-48530ac5077f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.448019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c65ae8-0ce5-4739-a75d-48530ac5077f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.474866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 808/1630] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:10 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:18:10.479513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c65ae8-0ce5-4739-a75d-48530ac5077f admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.500237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c65ae8-0ce5-4739-a75d-48530ac5077f admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.509527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a596cab-d020-4acf-bd39-859cc04fdef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.509527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a596cab-d020-4acf-bd39-859cc04fdef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.509527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a596cab-d020-4acf-bd39-859cc04fdef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.509981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a596cab-d020-4acf-bd39-859cc04fdef6 admin admin] PATH_INFO: `/v3/projects/b9efca5a8a504fe886d73b3f77bb3f13/users/3642711119da4189b03216d8350f34e4/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.513222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a596cab-d020-4acf-bd39-859cc04fdef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9efca5a8a504fe886d73b3f77bb3f13, user_id=3642711119da4189b03216d8350f34e4, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.519348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a596cab-d020-4acf-bd39-859cc04fdef6 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.519656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4ec10a-ba25-4f89-a3a0-fa97fad3a696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.521410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ec10a-ba25-4f89-a3a0-fa97fad3a696 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.522172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ec10a-ba25-4f89-a3a0-fa97fad3a696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.522621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4ec10a-ba25-4f89-a3a0-fa97fad3a696 admin admin] PATH_INFO: `/v3/projects/72e32fffa04745a99ec6808e5126cead/users/7582fbb3a93e44159d0bb41aac3a60de/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.530040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ec10a-ba25-4f89-a3a0-fa97fad3a696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e32fffa04745a99ec6808e5126cead, user_id=7582fbb3a93e44159d0bb41aac3a60de, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.533494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4ec10a-ba25-4f89-a3a0-fa97fad3a696 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.561590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 823/1631] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:10 2022] PUT /identity/v3/projects/b9efca5a8a504fe886d73b3f77bb3f13/users/3642711119da4189b03216d8350f34e4/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:10.563269 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 809/1632] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:10 2022] PUT /identity/v3/projects/72e32fffa04745a99ec6808e5126cead/users/7582fbb3a93e44159d0bb41aac3a60de/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:10.565161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ba373-f668-49bd-9189-3e037804eb32 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.565631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ba373-f668-49bd-9189-3e037804eb32 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.566070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8ba373-f668-49bd-9189-3e037804eb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.573810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e4104-4cba-44c2-a32c-9c53fd93d51e None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.575113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e4104-4cba-44c2-a32c-9c53fd93d51e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.575410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92e4104-4cba-44c2-a32c-9c53fd93d51e None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.577360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 824/1633] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jul 21 04:18:10 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:10.578894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b898a-5ba1-43ca-851b-f72dc95d004e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.579083 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b898a-5ba1-43ca-851b-f72dc95d004e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.579494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b898a-5ba1-43ca-851b-f72dc95d004e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.608058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-0a8ba373-f668-49bd-9189-3e037804eb32 None None] MFA Rules not processed for user `3642711119da4189b03216d8350f34e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:10.610648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0a8ba373-f668-49bd-9189-3e037804eb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:10.619682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b97b898a-5ba1-43ca-851b-f72dc95d004e None None] MFA Rules not processed for user `7582fbb3a93e44159d0bb41aac3a60de`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:10.621556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b97b898a-5ba1-43ca-851b-f72dc95d004e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:10.677435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:10.745504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 825/1634] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:10.747051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dd6e5-ae6b-454d-a525-c33c57aa740f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.747347 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dd6e5-ae6b-454d-a525-c33c57aa740f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.747624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05dd6e5-ae6b-454d-a525-c33c57aa740f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.760494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 810/1635] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:10 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:10.762410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e771761-18c8-4b3a-b0f4-710a0bb42842 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.762861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e771761-18c8-4b3a-b0f4-710a0bb42842 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.763338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e771761-18c8-4b3a-b0f4-710a0bb42842 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.764915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 811/1636] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jul 21 04:18:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:10.766755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e771761-18c8-4b3a-b0f4-710a0bb42842 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.791727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e05dd6e5-ae6b-454d-a525-c33c57aa740f None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:10.793038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e05dd6e5-ae6b-454d-a525-c33c57aa740f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:10.863675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:10.873227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e771761-18c8-4b3a-b0f4-710a0bb42842 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.878751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfba98-0eff-4c00-9178-03ce2f589246 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.880324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfba98-0eff-4c00-9178-03ce2f589246 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.880619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfba98-0eff-4c00-9178-03ce2f589246 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.880896 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfba98-0eff-4c00-9178-03ce2f589246 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.893695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfba98-0eff-4c00-9178-03ce2f589246 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.894797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfba98-0eff-4c00-9178-03ce2f589246 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.904458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 826/1637] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:18:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:10.906547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5793-21de-4139-819a-0a53e69f9486 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.907355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5793-21de-4139-819a-0a53e69f9486 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.908767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 812/1638] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:10.909058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5f5793-21de-4139-819a-0a53e69f9486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.910153 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfba98-0eff-4c00-9178-03ce2f589246 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.920643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfba98-0eff-4c00-9178-03ce2f589246 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:10.925543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c3699-8b9b-4991-84ab-5092fac31841 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:10.926206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3699-8b9b-4991-84ab-5092fac31841 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:10.926649 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3699-8b9b-4991-84ab-5092fac31841 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:10.927070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c3699-8b9b-4991-84ab-5092fac31841 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:10.945695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c3699-8b9b-4991-84ab-5092fac31841 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:10.948106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567c3699-8b9b-4991-84ab-5092fac31841 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:10.953391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-7f5f5793-21de-4139-819a-0a53e69f9486 None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:10.962122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 813/1639] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:10.962623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7f5f5793-21de-4139-819a-0a53e69f9486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:10.976377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c3699-8b9b-4991-84ab-5092fac31841 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:10.983063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 827/1640] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:18:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:10.995737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c3699-8b9b-4991-84ab-5092fac31841 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:11.000273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046e2f9-290c-4861-8cbd-d57c1cb5d553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:11.001056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e2f9-290c-4861-8cbd-d57c1cb5d553 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:11.001407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e2f9-290c-4861-8cbd-d57c1cb5d553 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:11.001757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046e2f9-290c-4861-8cbd-d57c1cb5d553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:11.014629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046e2f9-290c-4861-8cbd-d57c1cb5d553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:11.016181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046e2f9-290c-4861-8cbd-d57c1cb5d553 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:11.030325 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 814/1641] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:11.149811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5793-21de-4139-819a-0a53e69f9486 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:11.161191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5f5793-21de-4139-819a-0a53e69f9486 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:11.165427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379b26f-fe89-4957-a9f9-6da6804e9da7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:11.166294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379b26f-fe89-4957-a9f9-6da6804e9da7 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:11.166743 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379b26f-fe89-4957-a9f9-6da6804e9da7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:11.167237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3379b26f-fe89-4957-a9f9-6da6804e9da7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:11.180364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379b26f-fe89-4957-a9f9-6da6804e9da7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:11.182255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3379b26f-fe89-4957-a9f9-6da6804e9da7 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:11.211556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 828/1642] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:12.018636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046e2f9-290c-4861-8cbd-d57c1cb5d553 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:12.031292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046e2f9-290c-4861-8cbd-d57c1cb5d553 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:12.037042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec052a-def3-43e3-a807-f7e49ba30cb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:12.037871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec052a-def3-43e3-a807-f7e49ba30cb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:12.038161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec052a-def3-43e3-a807-f7e49ba30cb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:12.038439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec052a-def3-43e3-a807-f7e49ba30cb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:12.140829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec052a-def3-43e3-a807-f7e49ba30cb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:12.142727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ec052a-def3-43e3-a807-f7e49ba30cb3 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:12.158048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 815/1643] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:12 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:12.601052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379b26f-fe89-4957-a9f9-6da6804e9da7 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:12.655548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3379b26f-fe89-4957-a9f9-6da6804e9da7 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:12.669529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e9197-51a1-42ee-b80b-7debf13ddb36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:12.670204 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e9197-51a1-42ee-b80b-7debf13ddb36 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:12.670486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e9197-51a1-42ee-b80b-7debf13ddb36 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:12.670763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e9197-51a1-42ee-b80b-7debf13ddb36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:12.888092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec052a-def3-43e3-a807-f7e49ba30cb3 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:12.905487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e9197-51a1-42ee-b80b-7debf13ddb36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:12.908908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78e9197-51a1-42ee-b80b-7debf13ddb36 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:12.971719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 829/1644] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:13.044389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:13.156594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec052a-def3-43e3-a807-f7e49ba30cb3 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:13.172451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:13.173587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:13.175322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:13.185169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] PATH_INFO: `/v3/users/a708560af176421a91b75ce87574d77d` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:13.192857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a708560af176421a91b75ce87574d77d)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:13.194907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: WARNING py.warnings [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:13.194907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: warnings.warn(msg) Jul 21 04:18:13.194907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: Jul 21 04:18:13.203685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:13.437703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e9197-51a1-42ee-b80b-7debf13ddb36 service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:13.439027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a708560af176421a91b75ce87574d77d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:13.440835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a708560af176421a91b75ce87574d77d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:13.441466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a708560af176421a91b75ce87574d77d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:13.456270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e9197-51a1-42ee-b80b-7debf13ddb36 service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:13.457737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a708560af176421a91b75ce87574d77d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:13.475294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:13.476268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:13.476549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:13.476640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-49ea01f3-cd4f-42d2-8186-84fe087e8613 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a708560af176421a91b75ce87574d77d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:13.476822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] PATH_INFO: `/v3/users/74223bc5167f4e76a7361537368b4ac9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:13.482463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74223bc5167f4e76a7361537368b4ac9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:13.485208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:13.539497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 816/1645] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:12 2022] DELETE /identity/v3/users/a708560af176421a91b75ce87574d77d => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:13.544497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301e2c5-927f-4c70-b69f-52625122c68a None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:13.545236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301e2c5-927f-4c70-b69f-52625122c68a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:13.546284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301e2c5-927f-4c70-b69f-52625122c68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:13.590363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74223bc5167f4e76a7361537368b4ac9'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:13.591128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74223bc5167f4e76a7361537368b4ac9'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:13.591804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74223bc5167f4e76a7361537368b4ac9'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:13.603100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74223bc5167f4e76a7361537368b4ac9'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:13.608129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-8301e2c5-927f-4c70-b69f-52625122c68a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:13.609337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8301e2c5-927f-4c70-b69f-52625122c68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:13.618125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74223bc5167f4e76a7361537368b4ac9'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:13.683394 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 817/1646] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:13.686991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 830/1647] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:13 2022] DELETE /identity/v3/users/74223bc5167f4e76a7361537368b4ac9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:13.693567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:13.696671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dd83e-0065-42b7-8c23-cddb9ee12596 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:13.697106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dd83e-0065-42b7-8c23-cddb9ee12596 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:13.697257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:13.697578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94dd83e-0065-42b7-8c23-cddb9ee12596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:13.720229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-b94dd83e-0065-42b7-8c23-cddb9ee12596 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:13.728855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b94dd83e-0065-42b7-8c23-cddb9ee12596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:13.773101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:13.793870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:13.835200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375701bb-d3d7-4b83-882a-f722481bd906 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:13.841285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 818/1648] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:13.844161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f26de-c0cc-4bb5-afc1-bcc43ff6db3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:13.845037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f26de-c0cc-4bb5-afc1-bcc43ff6db3d service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:13.845214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f26de-c0cc-4bb5-afc1-bcc43ff6db3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:13.845529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f26de-c0cc-4bb5-afc1-bcc43ff6db3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:13.846320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dd83e-0065-42b7-8c23-cddb9ee12596 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:13.866888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f26de-c0cc-4bb5-afc1-bcc43ff6db3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:13.867409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94dd83e-0065-42b7-8c23-cddb9ee12596 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:13.868396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f26de-c0cc-4bb5-afc1-bcc43ff6db3d service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:13.877510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ae6d-e760-47dd-bc1a-8f819920470b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:13.879288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ae6d-e760-47dd-bc1a-8f819920470b service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:13.880137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ae6d-e760-47dd-bc1a-8f819920470b service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:13.880945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63ae6d-e760-47dd-bc1a-8f819920470b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:13.896156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ae6d-e760-47dd-bc1a-8f819920470b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:13.898625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63ae6d-e760-47dd-bc1a-8f819920470b service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:13.906045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 831/1649] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:13.916743 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 819/1650] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:15.501547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f26de-c0cc-4bb5-afc1-bcc43ff6db3d service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:15.503349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-de7f26de-c0cc-4bb5-afc1-bcc43ff6db3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:15.529018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f26de-c0cc-4bb5-afc1-bcc43ff6db3d service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:15.546466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:15.549157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:15.549804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:15.551276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] PATH_INFO: `/v3/projects/b76d29ad436b46b9a2c347aa3920b887` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:15.557295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b76d29ad436b46b9a2c347aa3920b887)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:15.557902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ae6d-e760-47dd-bc1a-8f819920470b service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:15.560796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2f63ae6d-e760-47dd-bc1a-8f819920470b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:15.561158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: WARNING py.warnings [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 21 04:18:15.561158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: warnings.warn(msg) Jul 21 04:18:15.561158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: Jul 21 04:18:15.565331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:15.606151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63ae6d-e760-47dd-bc1a-8f819920470b service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:15.623615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:15.624946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:15.625376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:15.625794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] PATH_INFO: `/v3/projects/e26c92030a3c47a8a3ccbc17dba9ff7f` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:15.627724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26c92030a3c47a8a3ccbc17dba9ff7f)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:15.629863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:15.727317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b76d29ad436b46b9a2c347aa3920b887', 'request_id': 'req-9eff3de6-e2fd-424d-944c-ed61a20cea48'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.747980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b76d29ad436b46b9a2c347aa3920b887', 'request_id': 'req-9eff3de6-e2fd-424d-944c-ed61a20cea48'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.757716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b76d29ad436b46b9a2c347aa3920b887', 'request_id': 'req-9eff3de6-e2fd-424d-944c-ed61a20cea48'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.796213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26c92030a3c47a8a3ccbc17dba9ff7f', 'request_id': 'req-4a9b26fd-442b-4f4e-ad88-a14470b22803'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.815567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26c92030a3c47a8a3ccbc17dba9ff7f', 'request_id': 'req-4a9b26fd-442b-4f4e-ad88-a14470b22803'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.818650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] The token cache is being invalidate because project b76d29ad436b46b9a2c347aa3920b887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:15.819071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.822887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9eff3de6-e2fd-424d-944c-ed61a20cea48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.825350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 832/1651] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:15 2022] DELETE /identity/v3/projects/b76d29ad436b46b9a2c347aa3920b887 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:15.827087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26c92030a3c47a8a3ccbc17dba9ff7f', 'request_id': 'req-4a9b26fd-442b-4f4e-ad88-a14470b22803'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.830457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eadd0e-086f-4d64-884e-614f62bac895 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:15.830749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eadd0e-086f-4d64-884e-614f62bac895 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:15.831069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eadd0e-086f-4d64-884e-614f62bac895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:15.861723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] The token cache is being invalidate because project e26c92030a3c47a8a3ccbc17dba9ff7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:15.862287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.863127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:15.868205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 820/1652] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:15 2022] DELETE /identity/v3/projects/e26c92030a3c47a8a3ccbc17dba9ff7f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:15.870001 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:15.875969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:15.896909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-41eadd0e-086f-4d64-884e-614f62bac895 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:15.898437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-41eadd0e-086f-4d64-884e-614f62bac895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:16.022683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b26fd-442b-4f4e-ad88-a14470b22803 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.050351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.056465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.056465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.056775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] PATH_INFO: `/v3/users/3642711119da4189b03216d8350f34e4` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.058844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3642711119da4189b03216d8350f34e4)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.066086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.084509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 833/1653] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:16.092871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec1487-5b08-4d35-a88f-990165cfa7a9 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.093342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec1487-5b08-4d35-a88f-990165cfa7a9 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.093754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ec1487-5b08-4d35-a88f-990165cfa7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.127565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-69ec1487-5b08-4d35-a88f-990165cfa7a9 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:16.130202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-69ec1487-5b08-4d35-a88f-990165cfa7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:16.152620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 834/1654] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:16.154135 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec1487-5b08-4d35-a88f-990165cfa7a9 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.173253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ec1487-5b08-4d35-a88f-990165cfa7a9 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.193814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c379e6-abb5-40cf-b8d2-98eac7347e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.194501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c379e6-abb5-40cf-b8d2-98eac7347e00 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.194783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c379e6-abb5-40cf-b8d2-98eac7347e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.195086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c379e6-abb5-40cf-b8d2-98eac7347e00 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.195835 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c379e6-abb5-40cf-b8d2-98eac7347e00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:16.197329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c379e6-abb5-40cf-b8d2-98eac7347e00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.199124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c379e6-abb5-40cf-b8d2-98eac7347e00 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.220988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3642711119da4189b03216d8350f34e4'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:16.221893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3642711119da4189b03216d8350f34e4'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:16.223313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3642711119da4189b03216d8350f34e4'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:16.237391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3642711119da4189b03216d8350f34e4'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:16.244704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:16.249045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 835/1655] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:16.254274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c379e6-abb5-40cf-b8d2-98eac7347e00 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.265222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f3c379e6-abb5-40cf-b8d2-98eac7347e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:16.266155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3642711119da4189b03216d8350f34e4'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:16.323595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c379e6-abb5-40cf-b8d2-98eac7347e00 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.350440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa701e7-6cbe-42e0-a97b-b4c151813968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.351717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa701e7-6cbe-42e0-a97b-b4c151813968 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.358174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 821/1656] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:15 2022] DELETE /identity/v3/users/3642711119da4189b03216d8350f34e4 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:16.358733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa701e7-6cbe-42e0-a97b-b4c151813968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.359231 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa701e7-6cbe-42e0-a97b-b4c151813968 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.362475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa701e7-6cbe-42e0-a97b-b4c151813968 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.365822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa701e7-6cbe-42e0-a97b-b4c151813968 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.443873 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.447082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:16.458675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 836/1657] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:16 2022] POST /identity/v3/projects => generated 365 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:16.462443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa701e7-6cbe-42e0-a97b-b4c151813968 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.517075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:16.650792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ff4e1-481b-4b8a-9d28-d27603d87886 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.754461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa701e7-6cbe-42e0-a97b-b4c151813968 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.770160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbfd63-34e6-4376-a50e-59affcbd1909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.770863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbfd63-34e6-4376-a50e-59affcbd1909 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.772841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbfd63-34e6-4376-a50e-59affcbd1909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.775426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fbfd63-34e6-4376-a50e-59affcbd1909 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.776617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbfd63-34e6-4376-a50e-59affcbd1909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.784925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fbfd63-34e6-4376-a50e-59affcbd1909 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.857188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 837/1658] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:16 2022] POST /identity/v3/users => generated 283 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:16.857188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbfd63-34e6-4376-a50e-59affcbd1909 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.867232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.868295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.868401 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.868683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] PATH_INFO: `/v3/users/a07422882b254a0596ef1032c04ab770` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.873435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07422882b254a0596ef1032c04ab770)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.875477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.887839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fbfd63-34e6-4376-a50e-59affcbd1909 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:16.906278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d479-ae52-41f2-8d1f-a3b734afa0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:16.907003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d479-ae52-41f2-8d1f-a3b734afa0c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:16.907298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d479-ae52-41f2-8d1f-a3b734afa0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:16.907579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d479-ae52-41f2-8d1f-a3b734afa0c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:16.908363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d479-ae52-41f2-8d1f-a3b734afa0c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:16.915702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d479-ae52-41f2-8d1f-a3b734afa0c3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:16.962181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 838/1659] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:18:16.964604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d479-ae52-41f2-8d1f-a3b734afa0c3 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:16.986212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d479-ae52-41f2-8d1f-a3b734afa0c3 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.012194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7d55-a04b-4707-9a32-9c9563a6e341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.014062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7d55-a04b-4707-9a32-9c9563a6e341 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.014361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7d55-a04b-4707-9a32-9c9563a6e341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.014644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d7d55-a04b-4707-9a32-9c9563a6e341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.018012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d7d55-a04b-4707-9a32-9c9563a6e341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.020968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07422882b254a0596ef1032c04ab770'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:17.022261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07422882b254a0596ef1032c04ab770'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:17.022637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d7d55-a04b-4707-9a32-9c9563a6e341 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:17.024413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07422882b254a0596ef1032c04ab770'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:17.045851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07422882b254a0596ef1032c04ab770'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:17.057703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 839/1660] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:17.060640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7d55-a04b-4707-9a32-9c9563a6e341 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.062762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6a6d7d55-a04b-4707-9a32-9c9563a6e341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.072596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d2ec18f2-ff5b-4ed2-b8f3-f07a46dc54af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07422882b254a0596ef1032c04ab770'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:17.109979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 822/1661] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:16 2022] DELETE /identity/v3/users/a07422882b254a0596ef1032c04ab770 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:17.112889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e8036-82eb-48f1-8f8c-6fc446c0d13c None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.113395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e8036-82eb-48f1-8f8c-6fc446c0d13c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.114597 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e8036-82eb-48f1-8f8c-6fc446c0d13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.117114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d7d55-a04b-4707-9a32-9c9563a6e341 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.124610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:17.142130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-db7e8036-82eb-48f1-8f8c-6fc446c0d13c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:17.145465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-db7e8036-82eb-48f1-8f8c-6fc446c0d13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.259192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 823/1662] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:17.273176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e8036-82eb-48f1-8f8c-6fc446c0d13c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.274765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-db7e8036-82eb-48f1-8f8c-6fc446c0d13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.299302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ca3f8-d47a-4ba4-bbc0-594ffe421472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.300357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca3f8-d47a-4ba4-bbc0-594ffe421472 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.300663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca3f8-d47a-4ba4-bbc0-594ffe421472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.301010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ca3f8-d47a-4ba4-bbc0-594ffe421472 admin admin] PATH_INFO: `/v3/projects/3cb8e24971b84c379c545713bccc97ad/users/c3f517246cd446cba1695f098902bec6/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.337359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ca3f8-d47a-4ba4-bbc0-594ffe421472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cb8e24971b84c379c545713bccc97ad, user_id=c3f517246cd446cba1695f098902bec6, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.341365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ca3f8-d47a-4ba4-bbc0-594ffe421472 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:17.373504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 840/1663] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:17 2022] PUT /identity/v3/projects/3cb8e24971b84c379c545713bccc97ad/users/c3f517246cd446cba1695f098902bec6/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:17.388037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5cd76-7364-4669-b313-600a658dcb48 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.388365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5cd76-7364-4669-b313-600a658dcb48 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.388644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5cd76-7364-4669-b313-600a658dcb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.442446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e8036-82eb-48f1-8f8c-6fc446c0d13c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.444428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b4b5cd76-7364-4669-b313-600a658dcb48 None None] MFA Rules not processed for user `c3f517246cd446cba1695f098902bec6`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:17.445658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b4b5cd76-7364-4669-b313-600a658dcb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:17.551241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:17.571007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39469c80-eeb4-4b4e-bf96-8ddf9464bf64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.571688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39469c80-eeb4-4b4e-bf96-8ddf9464bf64 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.571982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39469c80-eeb4-4b4e-bf96-8ddf9464bf64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.572261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39469c80-eeb4-4b4e-bf96-8ddf9464bf64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.590693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 841/1664] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:17.592473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5cd76-7364-4669-b313-600a658dcb48 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.684866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39469c80-eeb4-4b4e-bf96-8ddf9464bf64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.687023 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39469c80-eeb4-4b4e-bf96-8ddf9464bf64 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:17.710044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5cd76-7364-4669-b313-600a658dcb48 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.720145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807f254-7190-40cc-b714-d328c9ce07c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.720837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807f254-7190-40cc-b714-d328c9ce07c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.721122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807f254-7190-40cc-b714-d328c9ce07c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.721507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3807f254-7190-40cc-b714-d328c9ce07c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.721907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 824/1665] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:17.724000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807f254-7190-40cc-b714-d328c9ce07c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.726403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3807f254-7190-40cc-b714-d328c9ce07c9 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:17.764586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 842/1666] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:17 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:17.768991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39469c80-eeb4-4b4e-bf96-8ddf9464bf64 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.783067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39469c80-eeb4-4b4e-bf96-8ddf9464bf64 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.799371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:17.885717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dad059-f86a-44c0-93e6-90c424eadbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.886643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dad059-f86a-44c0-93e6-90c424eadbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.886934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dad059-f86a-44c0-93e6-90c424eadbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.887655 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dad059-f86a-44c0-93e6-90c424eadbc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.888488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dad059-f86a-44c0-93e6-90c424eadbc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.891746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dad059-f86a-44c0-93e6-90c424eadbc1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:17.942702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 825/1667] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:17 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:17.946762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807f254-7190-40cc-b714-d328c9ce07c9 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:17.961756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3807f254-7190-40cc-b714-d328c9ce07c9 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:17.976241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2188cb7-6570-49d9-bf41-eb9dae8eace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:17.976941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2188cb7-6570-49d9-bf41-eb9dae8eace7 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:17.977236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2188cb7-6570-49d9-bf41-eb9dae8eace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:17.977518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2188cb7-6570-49d9-bf41-eb9dae8eace7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:17.978332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2188cb7-6570-49d9-bf41-eb9dae8eace7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:17.981193 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2188cb7-6570-49d9-bf41-eb9dae8eace7 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.014322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 843/1668] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:18.018781 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dad059-f86a-44c0-93e6-90c424eadbc1 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.038328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dad059-f86a-44c0-93e6-90c424eadbc1 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.056918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaa009-865f-4e37-8e5c-0772d04a107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.057849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaa009-865f-4e37-8e5c-0772d04a107d admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.058181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaa009-865f-4e37-8e5c-0772d04a107d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.058468 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aaa009-865f-4e37-8e5c-0772d04a107d admin admin] PATH_INFO: `/v3/projects/5c999c34af2f406aa643939eee06e690/users/35c062e79b4a4ff99da44e744b72f3e6/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.093999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaa009-865f-4e37-8e5c-0772d04a107d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c999c34af2f406aa643939eee06e690, user_id=35c062e79b4a4ff99da44e744b72f3e6, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.097649 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aaa009-865f-4e37-8e5c-0772d04a107d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.126971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 826/1669] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:18 2022] PUT /identity/v3/projects/5c999c34af2f406aa643939eee06e690/users/35c062e79b4a4ff99da44e744b72f3e6/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:18.131559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2188cb7-6570-49d9-bf41-eb9dae8eace7 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.147796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2188cb7-6570-49d9-bf41-eb9dae8eace7 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.306529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ebcb7-39cb-420f-8e1c-a14fc1d7f1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.307329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ebcb7-39cb-420f-8e1c-a14fc1d7f1d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.307625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ebcb7-39cb-420f-8e1c-a14fc1d7f1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.307915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ebcb7-39cb-420f-8e1c-a14fc1d7f1d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.308701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ebcb7-39cb-420f-8e1c-a14fc1d7f1d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.316041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ebcb7-39cb-420f-8e1c-a14fc1d7f1d5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.347575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 844/1670] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:18.350830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaa009-865f-4e37-8e5c-0772d04a107d admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.385510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aaa009-865f-4e37-8e5c-0772d04a107d admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.399943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4d7a7-1c93-4f36-9ea3-f1fd1a6574fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.400906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d7a7-1c93-4f36-9ea3-f1fd1a6574fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.401263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d7a7-1c93-4f36-9ea3-f1fd1a6574fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.401498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb4d7a7-1c93-4f36-9ea3-f1fd1a6574fc admin admin] PATH_INFO: `/v3/projects/5c999c34af2f406aa643939eee06e690/users/35c062e79b4a4ff99da44e744b72f3e6/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.405912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4d7a7-1c93-4f36-9ea3-f1fd1a6574fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c999c34af2f406aa643939eee06e690, user_id=35c062e79b4a4ff99da44e744b72f3e6, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.413765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb4d7a7-1c93-4f36-9ea3-f1fd1a6574fc admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.449628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 827/1671] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:18 2022] PUT /identity/v3/projects/5c999c34af2f406aa643939eee06e690/users/35c062e79b4a4ff99da44e744b72f3e6/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:18.465284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e469f2-1872-44a2-8c5c-f7254be3aacc None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.465662 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e469f2-1872-44a2-8c5c-f7254be3aacc None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.466000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e469f2-1872-44a2-8c5c-f7254be3aacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.514365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-81e469f2-1872-44a2-8c5c-f7254be3aacc None None] MFA Rules not processed for user `35c062e79b4a4ff99da44e744b72f3e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:18.515885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-81e469f2-1872-44a2-8c5c-f7254be3aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:18.618505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:18.658040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 845/1672] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:18 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:18.668611 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4d7a7-1c93-4f36-9ea3-f1fd1a6574fc admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.670774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0eb4d7a7-1c93-4f36-9ea3-f1fd1a6574fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:18.679818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e469f2-1872-44a2-8c5c-f7254be3aacc None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:18.681555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-81e469f2-1872-44a2-8c5c-f7254be3aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:18.790144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb4d7a7-1c93-4f36-9ea3-f1fd1a6574fc admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.797889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444dad5f-7263-4d61-9125-899a27dafa90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.799330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dad5f-7263-4d61-9125-899a27dafa90 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.799802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dad5f-7263-4d61-9125-899a27dafa90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.800148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444dad5f-7263-4d61-9125-899a27dafa90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.815732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dad5f-7263-4d61-9125-899a27dafa90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.818594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444dad5f-7263-4d61-9125-899a27dafa90 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:18.851546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 828/1673] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:18 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:18.878531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e469f2-1872-44a2-8c5c-f7254be3aacc None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:18.892943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:18.894203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:18.895846 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:18.898540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] PATH_INFO: `/v3/projects/b9efca5a8a504fe886d73b3f77bb3f13` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:18.900276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9efca5a8a504fe886d73b3f77bb3f13)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:18.910212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.043140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9efca5a8a504fe886d73b3f77bb3f13', 'request_id': 'req-c68ef039-8e17-4a35-977c-dc06d10e0d3e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.076965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9efca5a8a504fe886d73b3f77bb3f13', 'request_id': 'req-c68ef039-8e17-4a35-977c-dc06d10e0d3e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.100655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9efca5a8a504fe886d73b3f77bb3f13', 'request_id': 'req-c68ef039-8e17-4a35-977c-dc06d10e0d3e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.142311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] The token cache is being invalidate because project b9efca5a8a504fe886d73b3f77bb3f13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:19.143177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.145302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c68ef039-8e17-4a35-977c-dc06d10e0d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.149774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 846/1674] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:18 2022] DELETE /identity/v3/projects/b9efca5a8a504fe886d73b3f77bb3f13 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:19.154529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be630d-32dc-4e0c-bc2f-7d90886764f5 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.154849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be630d-32dc-4e0c-bc2f-7d90886764f5 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.155401 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be630d-32dc-4e0c-bc2f-7d90886764f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.202642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-48be630d-32dc-4e0c-bc2f-7d90886764f5 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:19.202642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-48be630d-32dc-4e0c-bc2f-7d90886764f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:19.331709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 829/1675] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:19.340616 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa19910-bfa5-4189-b1f8-11ded2309267 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.341270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa19910-bfa5-4189-b1f8-11ded2309267 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.341568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa19910-bfa5-4189-b1f8-11ded2309267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.380413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-daa19910-bfa5-4189-b1f8-11ded2309267 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:19.382114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-daa19910-bfa5-4189-b1f8-11ded2309267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:19.417507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be630d-32dc-4e0c-bc2f-7d90886764f5 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.423145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 847/1676] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:19.436705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be630d-32dc-4e0c-bc2f-7d90886764f5 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.455579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26687447-332c-437d-837f-dd123c9baad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.456137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687447-332c-437d-837f-dd123c9baad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.456429 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687447-332c-437d-837f-dd123c9baad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.456712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26687447-332c-437d-837f-dd123c9baad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.458428 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26687447-332c-437d-837f-dd123c9baad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:19.458813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26687447-332c-437d-837f-dd123c9baad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.460638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26687447-332c-437d-837f-dd123c9baad5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.465728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:19.499356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa19910-bfa5-4189-b1f8-11ded2309267 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.500920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 830/1677] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:19.501043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-daa19910-bfa5-4189-b1f8-11ded2309267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:19.502036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26687447-332c-437d-837f-dd123c9baad5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.522984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa19910-bfa5-4189-b1f8-11ded2309267 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.529847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26687447-332c-437d-837f-dd123c9baad5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.532176 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.533321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.537711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.538221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] PATH_INFO: `/v3/users/a0edea9c9a3946c880a7231aa9ce2325` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.541441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0edea9c9a3946c880a7231aa9ce2325)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.543222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c1f1-b02c-4e03-a28a-2582bee6b68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:19.543908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c1f1-b02c-4e03-a28a-2582bee6b68a admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.544197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c1f1-b02c-4e03-a28a-2582bee6b68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.544481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa4c1f1-b02c-4e03-a28a-2582bee6b68a admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.545679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4c1f1-b02c-4e03-a28a-2582bee6b68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:19.550625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa4c1f1-b02c-4e03-a28a-2582bee6b68a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.553686 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:19.630906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 831/1678] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:19 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:19.631895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c1f1-b02c-4e03-a28a-2582bee6b68a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:19.666482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0edea9c9a3946c880a7231aa9ce2325'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.667887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0edea9c9a3946c880a7231aa9ce2325'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.668482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0edea9c9a3946c880a7231aa9ce2325'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.680426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0edea9c9a3946c880a7231aa9ce2325'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.715657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8272d004-b52a-481a-80b1-c2813a8978ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0edea9c9a3946c880a7231aa9ce2325'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:19.724411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:19.774999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 848/1679] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:19 2022] DELETE /identity/v3/users/a0edea9c9a3946c880a7231aa9ce2325 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:19.779886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8f55d-61ed-46d3-afa4-7c455b7e203d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:19.780228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8f55d-61ed-46d3-afa4-7c455b7e203d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:19.780515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8f55d-61ed-46d3-afa4-7c455b7e203d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:19.837769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa4c1f1-b02c-4e03-a28a-2582bee6b68a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:19.858396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-07a8f55d-61ed-46d3-afa4-7c455b7e203d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:19.868523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-07a8f55d-61ed-46d3-afa4-7c455b7e203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.074634 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c9f78-c590-41ab-a81d-32bd32957408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.076089 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c9f78-c590-41ab-a81d-32bd32957408 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.076389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c9f78-c590-41ab-a81d-32bd32957408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.076672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7c9f78-c590-41ab-a81d-32bd32957408 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.077390 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c9f78-c590-41ab-a81d-32bd32957408 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:20.079548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7c9f78-c590-41ab-a81d-32bd32957408 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:20.129373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 849/1680] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:20.130621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8f55d-61ed-46d3-afa4-7c455b7e203d None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:20.135535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 832/1681] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:19 2022] POST /identity/v3/users => generated 287 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:20.135981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-07a8f55d-61ed-46d3-afa4-7c455b7e203d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.136687 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c9f78-c590-41ab-a81d-32bd32957408 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:20.138339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2c7c9f78-c590-41ab-a81d-32bd32957408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.159103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7c9f78-c590-41ab-a81d-32bd32957408 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:20.174296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8f55d-61ed-46d3-afa4-7c455b7e203d None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:20.183261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.183261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.183261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.183261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] PATH_INFO: `/v3/users/c3f517246cd446cba1695f098902bec6` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.183640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f517246cd446cba1695f098902bec6)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:20.192712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.193478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:20.193653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.193894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.194173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] PATH_INFO: `/v3/projects/4a8d9717833e4f8fab5a7a99c6fc79cf` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.197980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a8d9717833e4f8fab5a7a99c6fc79cf)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:20.200292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:20.349534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a8d9717833e4f8fab5a7a99c6fc79cf', 'request_id': 'req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.367715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a8d9717833e4f8fab5a7a99c6fc79cf', 'request_id': 'req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.381762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a8d9717833e4f8fab5a7a99c6fc79cf', 'request_id': 'req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.394095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f517246cd446cba1695f098902bec6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.398362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f517246cd446cba1695f098902bec6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.418083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f517246cd446cba1695f098902bec6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.440372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] The token cache is being invalidate because project 4a8d9717833e4f8fab5a7a99c6fc79cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:20.440672 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.451348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.453618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 850/1682] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:20 2022] DELETE /identity/v3/projects/4a8d9717833e4f8fab5a7a99c6fc79cf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:20.459007 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:20.464124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.496939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f517246cd446cba1695f098902bec6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.523639 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f517246cd446cba1695f098902bec6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:20.525728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:20.588761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 833/1683] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:20 2022] DELETE /identity/v3/users/c3f517246cd446cba1695f098902bec6 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:20.590037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:20.593029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.668888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c33ec5-a50f-40ed-9486-b5d10ac80efb admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:20.699005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:20.811202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91881988-33aa-4e54-98a5-d846b4555771 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:20.820535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00c9923-bce0-41d6-ae5f-a94f25e91ab6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.821315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9923-bce0-41d6-ae5f-a94f25e91ab6 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.821703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9923-bce0-41d6-ae5f-a94f25e91ab6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.823496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00c9923-bce0-41d6-ae5f-a94f25e91ab6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.838433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d00c9923-bce0-41d6-ae5f-a94f25e91ab6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.875772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55cac4f-06ab-4a0b-bcee-ee53da776b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:20.877004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cac4f-06ab-4a0b-bcee-ee53da776b40 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.877298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cac4f-06ab-4a0b-bcee-ee53da776b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.877581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55cac4f-06ab-4a0b-bcee-ee53da776b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.878331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cac4f-06ab-4a0b-bcee-ee53da776b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:20.880572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55cac4f-06ab-4a0b-bcee-ee53da776b40 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:20.905102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 851/1684] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:20.905102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee776f-4905-4531-8523-67a2485c4c91 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.906574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee776f-4905-4531-8523-67a2485c4c91 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.908064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee776f-4905-4531-8523-67a2485c4c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:20.965654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b0ee776f-4905-4531-8523-67a2485c4c91 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:20.966898 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b0ee776f-4905-4531-8523-67a2485c4c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:20.976637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 852/1685] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:20.979004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41a48-1b03-4a27-966b-5bbc19e5fcfc None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:20.980075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41a48-1b03-4a27-966b-5bbc19e5fcfc None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:20.980434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa41a48-1b03-4a27-966b-5bbc19e5fcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.010702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-0fa41a48-1b03-4a27-966b-5bbc19e5fcfc None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:21.012204 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0fa41a48-1b03-4a27-966b-5bbc19e5fcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.028704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 853/1686] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:21.030363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc65c01-7a09-4ef8-9048-86c3b351cb7c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.030861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc65c01-7a09-4ef8-9048-86c3b351cb7c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.031463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc65c01-7a09-4ef8-9048-86c3b351cb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.057903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c9923-bce0-41d6-ae5f-a94f25e91ab6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.061674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00c9923-bce0-41d6-ae5f-a94f25e91ab6 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.064446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1dc65c01-7a09-4ef8-9048-86c3b351cb7c None None] MFA Rules not processed for user `94d0ed0857064f368e9f09b434bf93fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:21.072105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1dc65c01-7a09-4ef8-9048-86c3b351cb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.100715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 834/1687] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:21.105027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faef77-2a54-422c-ae5e-3a104ffc2c33 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.108278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faef77-2a54-422c-ae5e-3a104ffc2c33 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.108680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69faef77-2a54-422c-ae5e-3a104ffc2c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.177460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 854/1688] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:21.184731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-69faef77-2a54-422c-ae5e-3a104ffc2c33 None None] MFA Rules not processed for user `eed183b5cd59420da43e87788fd39051`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:21.186280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-69faef77-2a54-422c-ae5e-3a104ffc2c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.191258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc65c01-7a09-4ef8-9048-86c3b351cb7c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.232987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc65c01-7a09-4ef8-9048-86c3b351cb7c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.250274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c788ac9-3d8b-4f1f-9b6c-92aba3e7b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.253223 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788ac9-3d8b-4f1f-9b6c-92aba3e7b3da admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.253482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788ac9-3d8b-4f1f-9b6c-92aba3e7b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.253769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c788ac9-3d8b-4f1f-9b6c-92aba3e7b3da admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.254624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c788ac9-3d8b-4f1f-9b6c-92aba3e7b3da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.257540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c788ac9-3d8b-4f1f-9b6c-92aba3e7b3da admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.296614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 855/1689] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:21.296614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ec48-cabb-45d2-aca1-b37c7c49aafa None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.296614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ec48-cabb-45d2-aca1-b37c7c49aafa None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.297335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f90ec48-cabb-45d2-aca1-b37c7c49aafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.330577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-3f90ec48-cabb-45d2-aca1-b37c7c49aafa None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:21.332427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3f90ec48-cabb-45d2-aca1-b37c7c49aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.345913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 856/1690] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:21.346823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90ec48-cabb-45d2-aca1-b37c7c49aafa None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.348757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3f90ec48-cabb-45d2-aca1-b37c7c49aafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.353527 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 835/1691] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:21.356046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faef77-2a54-422c-ae5e-3a104ffc2c33 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.361588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-69faef77-2a54-422c-ae5e-3a104ffc2c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.392536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f90ec48-cabb-45d2-aca1-b37c7c49aafa None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.400087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c179-5587-4408-b6de-377dcc555e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.400790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c179-5587-4408-b6de-377dcc555e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.401128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c179-5587-4408-b6de-377dcc555e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.401479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439c179-5587-4408-b6de-377dcc555e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.415048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:21.427866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c179-5587-4408-b6de-377dcc555e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.431434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4439c179-5587-4408-b6de-377dcc555e65 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.467994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 857/1692] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:21.470306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c179-5587-4408-b6de-377dcc555e65 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.498802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439c179-5587-4408-b6de-377dcc555e65 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.515204 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbc36e-c983-4fdf-aef4-2716deeec195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.516140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbc36e-c983-4fdf-aef4-2716deeec195 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.516423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbc36e-c983-4fdf-aef4-2716deeec195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.516703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbc36e-c983-4fdf-aef4-2716deeec195 admin admin] PATH_INFO: `/v3/projects/59cc42e3aea448f7a49ef19b801a4f72/users/7e21e2b825634c3182cd2d6729af43dc/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.548013 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69faef77-2a54-422c-ae5e-3a104ffc2c33 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.556114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbc36e-c983-4fdf-aef4-2716deeec195 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cc42e3aea448f7a49ef19b801a4f72, user_id=7e21e2b825634c3182cd2d6729af43dc, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.560016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbc36e-c983-4fdf-aef4-2716deeec195 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.574226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f12fb-fa66-487b-8dd9-2d9fa1b0b353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.575639 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f12fb-fa66-487b-8dd9-2d9fa1b0b353 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.576161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f12fb-fa66-487b-8dd9-2d9fa1b0b353 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.576642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f12fb-fa66-487b-8dd9-2d9fa1b0b353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.591308 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 858/1693] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:21 2022] PUT /identity/v3/projects/59cc42e3aea448f7a49ef19b801a4f72/users/7e21e2b825634c3182cd2d6729af43dc/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:21.592095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbc36e-c983-4fdf-aef4-2716deeec195 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.593812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f12fb-fa66-487b-8dd9-2d9fa1b0b353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.595866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f12fb-fa66-487b-8dd9-2d9fa1b0b353 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.626142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 836/1694] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:21.627958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f5c37-cc77-4aa1-8ba7-bb0d99fc4175 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.633307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f5c37-cc77-4aa1-8ba7-bb0d99fc4175 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.633920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f5c37-cc77-4aa1-8ba7-bb0d99fc4175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.674923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:21.687413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-b43f5c37-cc77-4aa1-8ba7-bb0d99fc4175 None None] MFA Rules not processed for user `eed183b5cd59420da43e87788fd39051`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:21.690266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b43f5c37-cc77-4aa1-8ba7-bb0d99fc4175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.763574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbc36e-c983-4fdf-aef4-2716deeec195 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.779806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c320dd0c-2702-44a6-ae71-20c45504f576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.780847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320dd0c-2702-44a6-ae71-20c45504f576 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.781167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320dd0c-2702-44a6-ae71-20c45504f576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.781445 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c320dd0c-2702-44a6-ae71-20c45504f576 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.782656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320dd0c-2702-44a6-ae71-20c45504f576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:21.782656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320dd0c-2702-44a6-ae71-20c45504f576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.785965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c320dd0c-2702-44a6-ae71-20c45504f576 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.821870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 859/1695] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:21.821870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf60ae7-01e9-4351-94a6-11888f747595 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.821870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf60ae7-01e9-4351-94a6-11888f747595 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.821870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf60ae7-01e9-4351-94a6-11888f747595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.858011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 837/1696] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:21.858986 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f5c37-cc77-4aa1-8ba7-bb0d99fc4175 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.867890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-8bf60ae7-01e9-4351-94a6-11888f747595 None None] MFA Rules not processed for user `7e21e2b825634c3182cd2d6729af43dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:21.869339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8bf60ae7-01e9-4351-94a6-11888f747595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.880618 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f5c37-cc77-4aa1-8ba7-bb0d99fc4175 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:21.897033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f586344-18ed-4b79-a4ce-994309c4ae78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:21.897721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586344-18ed-4b79-a4ce-994309c4ae78 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:21.898470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586344-18ed-4b79-a4ce-994309c4ae78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:21.898470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f586344-18ed-4b79-a4ce-994309c4ae78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:21.899170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f586344-18ed-4b79-a4ce-994309c4ae78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:21.901114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f586344-18ed-4b79-a4ce-994309c4ae78 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:21.958258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 838/1697] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:21 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:21.959326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f586344-18ed-4b79-a4ce-994309c4ae78 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.964450 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9f586344-18ed-4b79-a4ce-994309c4ae78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:21.976875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 860/1698] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:21.978232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf60ae7-01e9-4351-94a6-11888f747595 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:21.993760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf60ae7-01e9-4351-94a6-11888f747595 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.124227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5accf4c-cc25-41eb-a88e-d8c85bf60122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.124999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5accf4c-cc25-41eb-a88e-d8c85bf60122 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.125294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5accf4c-cc25-41eb-a88e-d8c85bf60122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.125571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5accf4c-cc25-41eb-a88e-d8c85bf60122 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.126286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5accf4c-cc25-41eb-a88e-d8c85bf60122 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.129273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5accf4c-cc25-41eb-a88e-d8c85bf60122 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.130311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f586344-18ed-4b79-a4ce-994309c4ae78 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.153391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0113bfc-6cf8-4e66-b8fb-7c8a51f5e839 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.154074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0113bfc-6cf8-4e66-b8fb-7c8a51f5e839 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.154368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0113bfc-6cf8-4e66-b8fb-7c8a51f5e839 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.154648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0113bfc-6cf8-4e66-b8fb-7c8a51f5e839 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.162385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 861/1699] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:21 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:22.163374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5accf4c-cc25-41eb-a88e-d8c85bf60122 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.179018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5accf4c-cc25-41eb-a88e-d8c85bf60122 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.201362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f220-8758-4ecc-bf38-91f3cd6265e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.202329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f220-8758-4ecc-bf38-91f3cd6265e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.204642 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f220-8758-4ecc-bf38-91f3cd6265e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.205320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5f220-8758-4ecc-bf38-91f3cd6265e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.206808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5f220-8758-4ecc-bf38-91f3cd6265e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.212555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5f220-8758-4ecc-bf38-91f3cd6265e1 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.229303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:22.312854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 862/1700] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:22 2022] POST /identity/v3/projects => generated 373 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:22.315539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f220-8758-4ecc-bf38-91f3cd6265e1 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.341739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0113bfc-6cf8-4e66-b8fb-7c8a51f5e839 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.354776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0113bfc-6cf8-4e66-b8fb-7c8a51f5e839 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.391674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:22.403285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 839/1701] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:22.404363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0113bfc-6cf8-4e66-b8fb-7c8a51f5e839 service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.405844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d0113bfc-6cf8-4e66-b8fb-7c8a51f5e839 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:22.455964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0113bfc-6cf8-4e66-b8fb-7c8a51f5e839 service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.550391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5f220-8758-4ecc-bf38-91f3cd6265e1 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.574717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7f49a-bb76-45e1-ac8a-54235d02c8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.580261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7f49a-bb76-45e1-ac8a-54235d02c8f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.580571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7f49a-bb76-45e1-ac8a-54235d02c8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.584913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf7f49a-bb76-45e1-ac8a-54235d02c8f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.585728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7f49a-bb76-45e1-ac8a-54235d02c8f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.587488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf7f49a-bb76-45e1-ac8a-54235d02c8f2 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.599662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.600559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.600852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.601131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] PATH_INFO: `/v3/projects/0a0d880e4a9d4255a969d295dfd8e0ac` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.604267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a0d880e4a9d4255a969d295dfd8e0ac)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.606503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.654685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 863/1702] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:22.655783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7f49a-bb76-45e1-ac8a-54235d02c8f2 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.698655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf7f49a-bb76-45e1-ac8a-54235d02c8f2 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.717723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678be5a9-64dd-4baf-bc4a-1adda2a50d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.718540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be5a9-64dd-4baf-bc4a-1adda2a50d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.718907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be5a9-64dd-4baf-bc4a-1adda2a50d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.719322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678be5a9-64dd-4baf-bc4a-1adda2a50d23 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.720426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678be5a9-64dd-4baf-bc4a-1adda2a50d23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.726426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678be5a9-64dd-4baf-bc4a-1adda2a50d23 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.755216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a0d880e4a9d4255a969d295dfd8e0ac', 'request_id': 'req-8952ad4f-ee1d-45df-a338-f9982ea50005'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:22.774515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a0d880e4a9d4255a969d295dfd8e0ac', 'request_id': 'req-8952ad4f-ee1d-45df-a338-f9982ea50005'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:22.780768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 864/1703] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:22 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:22.781698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678be5a9-64dd-4baf-bc4a-1adda2a50d23 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.787461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a0d880e4a9d4255a969d295dfd8e0ac', 'request_id': 'req-8952ad4f-ee1d-45df-a338-f9982ea50005'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:22.798840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-678be5a9-64dd-4baf-bc4a-1adda2a50d23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:22.804929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] The token cache is being invalidate because project 0a0d880e4a9d4255a969d295dfd8e0ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:22.805567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:22.806932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:22.810589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 840/1704] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:22 2022] DELETE /identity/v3/projects/0a0d880e4a9d4255a969d295dfd8e0ac => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:22.811944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.814494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:22.840864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678be5a9-64dd-4baf-bc4a-1adda2a50d23 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.932871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:22.943514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952ad4f-ee1d-45df-a338-f9982ea50005 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:22.956474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b887c-a893-4316-a40d-166e763c1b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.958984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b887c-a893-4316-a40d-166e763c1b5c admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.959309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b887c-a893-4316-a40d-166e763c1b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.959596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b887c-a893-4316-a40d-166e763c1b5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.960045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:22.960436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b887c-a893-4316-a40d-166e763c1b5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.961117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:22.961495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:22.961868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] PATH_INFO: `/v3/projects/3cb8e24971b84c379c545713bccc97ad` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:22.963352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cb8e24971b84c379c545713bccc97ad)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:22.964869 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b887c-a893-4316-a40d-166e763c1b5c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.967545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:22.990784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 841/1705] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:22.991733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b887c-a893-4316-a40d-166e763c1b5c admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:22.999688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0d5b887c-a893-4316-a40d-166e763c1b5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:23.031369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b887c-a893-4316-a40d-166e763c1b5c admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:23.043452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00534b-781f-413e-b88b-7164ffba1451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:23.044180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00534b-781f-413e-b88b-7164ffba1451 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.046553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00534b-781f-413e-b88b-7164ffba1451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.048446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00534b-781f-413e-b88b-7164ffba1451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.052653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00534b-781f-413e-b88b-7164ffba1451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:23.057149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00534b-781f-413e-b88b-7164ffba1451 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:23.061674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cb8e24971b84c379c545713bccc97ad', 'request_id': 'req-8db85f63-be4e-4e68-8033-74caae689ee6'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:23.090496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 842/1706] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:22 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:23.095311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f9b44-0e98-490e-94fd-811cf371c470 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.095496 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cb8e24971b84c379c545713bccc97ad', 'request_id': 'req-8db85f63-be4e-4e68-8033-74caae689ee6'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:23.095643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f9b44-0e98-490e-94fd-811cf371c470 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.095889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f9b44-0e98-490e-94fd-811cf371c470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.107168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cb8e24971b84c379c545713bccc97ad', 'request_id': 'req-8db85f63-be4e-4e68-8033-74caae689ee6'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:23.138228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] The token cache is being invalidate because project 3cb8e24971b84c379c545713bccc97ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:23.138531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:23.139253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:23.143750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 865/1707] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:22 2022] DELETE /identity/v3/projects/3cb8e24971b84c379c545713bccc97ad => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:23.145930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.150258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:23.158538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1c7f9b44-0e98-490e-94fd-811cf371c470 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:23.159820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1c7f9b44-0e98-490e-94fd-811cf371c470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:23.249679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:23.298132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 843/1708] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:23.300037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f9b44-0e98-490e-94fd-811cf371c470 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.302306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1c7f9b44-0e98-490e-94fd-811cf371c470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:23.328940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db85f63-be4e-4e68-8033-74caae689ee6 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:23.334729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b04b3-050e-4e8b-b246-b038172a28a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:23.339448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b04b3-050e-4e8b-b246-b038172a28a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.339979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b04b3-050e-4e8b-b246-b038172a28a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.340273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b04b3-050e-4e8b-b246-b038172a28a9 admin admin] PATH_INFO: `/v3/projects/0e3ed71124614f9a9002ee3765e922bc/users/faca3e985bb4424984cccdd389564ad8/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.351756 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f9b44-0e98-490e-94fd-811cf371c470 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:23.363048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72e315-73d4-4c58-88dc-3950372f57a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:23.366454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72e315-73d4-4c58-88dc-3950372f57a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.367217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72e315-73d4-4c58-88dc-3950372f57a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.367737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72e315-73d4-4c58-88dc-3950372f57a7 admin admin] PATH_INFO: `/v3/projects/509619aaa8fe4a26816e5832872f4554/users/345a3af62cd44745be974ac74634dd52/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.397685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72e315-73d4-4c58-88dc-3950372f57a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509619aaa8fe4a26816e5832872f4554, user_id=345a3af62cd44745be974ac74634dd52, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:23.401188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72e315-73d4-4c58-88dc-3950372f57a7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:23.405004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b04b3-050e-4e8b-b246-b038172a28a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e3ed71124614f9a9002ee3765e922bc, user_id=faca3e985bb4424984cccdd389564ad8, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:23.414028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b04b3-050e-4e8b-b246-b038172a28a9 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:23.433105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 844/1709] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:23 2022] PUT /identity/v3/projects/509619aaa8fe4a26816e5832872f4554/users/345a3af62cd44745be974ac74634dd52/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:23.434871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72e315-73d4-4c58-88dc-3950372f57a7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.442071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4f72e315-73d4-4c58-88dc-3950372f57a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:23.451512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 866/1710] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:23 2022] PUT /identity/v3/projects/0e3ed71124614f9a9002ee3765e922bc/users/faca3e985bb4424984cccdd389564ad8/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:23.453444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ec4c2-d27f-49a8-83b2-f852c2208640 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.453987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ec4c2-d27f-49a8-83b2-f852c2208640 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.454534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2ec4c2-d27f-49a8-83b2-f852c2208640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.506659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-6d2ec4c2-d27f-49a8-83b2-f852c2208640 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:23.509419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6d2ec4c2-d27f-49a8-83b2-f852c2208640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:23.589537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72e315-73d4-4c58-88dc-3950372f57a7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:23.606605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 867/1711] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:23.609070 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ec4c2-d27f-49a8-83b2-f852c2208640 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.635827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2ec4c2-d27f-49a8-83b2-f852c2208640 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:23.641603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974c7e3-ed1a-494c-bafa-a93fb17a92af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:23.642373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c7e3-ed1a-494c-bafa-a93fb17a92af admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.642668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c7e3-ed1a-494c-bafa-a93fb17a92af admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.642925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974c7e3-ed1a-494c-bafa-a93fb17a92af admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.644007 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c7e3-ed1a-494c-bafa-a93fb17a92af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:23.648312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974c7e3-ed1a-494c-bafa-a93fb17a92af admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:23.663133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 868/1712] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:23 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:23.664895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cf8ae-6e0c-44ea-8171-c337f65d17df None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.665190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cf8ae-6e0c-44ea-8171-c337f65d17df None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.665511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489cf8ae-6e0c-44ea-8171-c337f65d17df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.696931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:23.698005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.698376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.698663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] PATH_INFO: `/v3/users/35c062e79b4a4ff99da44e744b72f3e6` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.703403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] RBAC: Authorizing `identity:delete_user(user_id=35c062e79b4a4ff99da44e744b72f3e6)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:23.705653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:23.706304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-489cf8ae-6e0c-44ea-8171-c337f65d17df None None] MFA Rules not processed for user `faca3e985bb4424984cccdd389564ad8`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:23.708288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-489cf8ae-6e0c-44ea-8171-c337f65d17df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:23.720326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:23.833177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35c062e79b4a4ff99da44e744b72f3e6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:23.836112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35c062e79b4a4ff99da44e744b72f3e6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:23.837165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35c062e79b4a4ff99da44e744b72f3e6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:23.850998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35c062e79b4a4ff99da44e744b72f3e6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:23.860046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 869/1713] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:23.861216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cf8ae-6e0c-44ea-8171-c337f65d17df None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.873245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35c062e79b4a4ff99da44e744b72f3e6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:23.900397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489cf8ae-6e0c-44ea-8171-c337f65d17df None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:23.915343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b3bf6-e766-454f-8685-7f9741bafd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:23.916046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3bf6-e766-454f-8685-7f9741bafd80 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.916339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3bf6-e766-454f-8685-7f9741bafd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.916604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b3bf6-e766-454f-8685-7f9741bafd80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.923111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 845/1714] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:23 2022] DELETE /identity/v3/users/35c062e79b4a4ff99da44e744b72f3e6 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:23.924059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b3bf6-e766-454f-8685-7f9741bafd80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:23.924422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b3bf6-e766-454f-8685-7f9741bafd80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:23.925284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.928047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b3bf6-e766-454f-8685-7f9741bafd80 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:23.930146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:23.955697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 870/1715] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:23.957489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783d03-5436-43de-b115-3bdef221dd24 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:23.957595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783d03-5436-43de-b115-3bdef221dd24 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:23.957975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa783d03-5436-43de-b115-3bdef221dd24 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:23.962712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 871/1716] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jul 21 04:18:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:23.963512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783d03-5436-43de-b115-3bdef221dd24 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:23.970567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fa783d03-5436-43de-b115-3bdef221dd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:24.033514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:24.096900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca255f-6fdc-433b-bc7d-cec29a65f94e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:24.107675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa783d03-5436-43de-b115-3bdef221dd24 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:24.109711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3937f39-1187-4b0c-bd4d-6b6dd41c7eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:24.110985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3937f39-1187-4b0c-bd4d-6b6dd41c7eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.111270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3937f39-1187-4b0c-bd4d-6b6dd41c7eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.111553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3937f39-1187-4b0c-bd4d-6b6dd41c7eff admin admin] PATH_INFO: `/v3/projects/509619aaa8fe4a26816e5832872f4554/users/345a3af62cd44745be974ac74634dd52/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.112406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae735df-97a9-4ac9-90c3-b2d39df46ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:24.113673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae735df-97a9-4ac9-90c3-b2d39df46ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.114277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae735df-97a9-4ac9-90c3-b2d39df46ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.114643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae735df-97a9-4ac9-90c3-b2d39df46ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.115466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae735df-97a9-4ac9-90c3-b2d39df46ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:24.117837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae735df-97a9-4ac9-90c3-b2d39df46ea5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:24.119902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3937f39-1187-4b0c-bd4d-6b6dd41c7eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=509619aaa8fe4a26816e5832872f4554, user_id=345a3af62cd44745be974ac74634dd52, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:24.122913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3937f39-1187-4b0c-bd4d-6b6dd41c7eff admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:24.164937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 846/1717] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:23 2022] PUT /identity/v3/projects/509619aaa8fe4a26816e5832872f4554/users/345a3af62cd44745be974ac74634dd52/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:24.167244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3937f39-1187-4b0c-bd4d-6b6dd41c7eff admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:24.170363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a3937f39-1187-4b0c-bd4d-6b6dd41c7eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:24.195747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 872/1718] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:23 2022] POST /identity/v3/projects => generated 385 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:24.200493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303c87e-2fbe-4e68-a4e0-88f190c0d853 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.202644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303c87e-2fbe-4e68-a4e0-88f190c0d853 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.203564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303c87e-2fbe-4e68-a4e0-88f190c0d853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.322603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-9303c87e-2fbe-4e68-a4e0-88f190c0d853 None None] MFA Rules not processed for user `b3b2d5dee6d240558a71331e05035a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:24.324101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9303c87e-2fbe-4e68-a4e0-88f190c0d853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:24.380918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3937f39-1187-4b0c-bd4d-6b6dd41c7eff admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:24.439682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:24.455814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 873/1719] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:18:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:24.458307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1d67c-d267-4917-81fd-b02cb6bf60b0 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.458835 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1d67c-d267-4917-81fd-b02cb6bf60b0 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.470420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1d67c-d267-4917-81fd-b02cb6bf60b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.529846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758425ff-7f35-4fff-ac0e-fa21920146d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:24.531201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758425ff-7f35-4fff-ac0e-fa21920146d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.531758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758425ff-7f35-4fff-ac0e-fa21920146d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.532046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758425ff-7f35-4fff-ac0e-fa21920146d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.532812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758425ff-7f35-4fff-ac0e-fa21920146d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:24.534778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758425ff-7f35-4fff-ac0e-fa21920146d1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:24.577554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-6ca1d67c-d267-4917-81fd-b02cb6bf60b0 None None] MFA Rules not processed for user `345a3af62cd44745be974ac74634dd52`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:24.583703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6ca1d67c-d267-4917-81fd-b02cb6bf60b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:24.597656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 847/1720] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:24 2022] POST /identity/v3/projects => generated 401 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:24.598370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758425ff-7f35-4fff-ac0e-fa21920146d1 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:24.808280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758425ff-7f35-4fff-ac0e-fa21920146d1 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:24.828862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0307-a3fb-43c8-848d-99c172bd0716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:24.829573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0307-a3fb-43c8-848d-99c172bd0716 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.829886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0307-a3fb-43c8-848d-99c172bd0716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.830153 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0307-a3fb-43c8-848d-99c172bd0716 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.830909 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0307-a3fb-43c8-848d-99c172bd0716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:24.833083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0307-a3fb-43c8-848d-99c172bd0716 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:24.850389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 874/1721] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:24.852437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1d67c-d267-4917-81fd-b02cb6bf60b0 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:24.857081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6ca1d67c-d267-4917-81fd-b02cb6bf60b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:24.885039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 848/1722] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:24 2022] POST /identity/v3/users => generated 299 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:24.888719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0307-a3fb-43c8-848d-99c172bd0716 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:24.908215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1d67c-d267-4917-81fd-b02cb6bf60b0 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:24.930847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0307-a3fb-43c8-848d-99c172bd0716 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:24.959119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336df77-b90e-4ef2-9248-ead93ed7cfe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:24.959826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336df77-b90e-4ef2-9248-ead93ed7cfe6 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:24.960116 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336df77-b90e-4ef2-9248-ead93ed7cfe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:24.961417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336df77-b90e-4ef2-9248-ead93ed7cfe6 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:24.962154 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336df77-b90e-4ef2-9248-ead93ed7cfe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:24.964194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336df77-b90e-4ef2-9248-ead93ed7cfe6 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:25.012883 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:25.031376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 849/1723] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:24 2022] POST /identity/v3/users => generated 301 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:25.032335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336df77-b90e-4ef2-9248-ead93ed7cfe6 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:25.041538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3336df77-b90e-4ef2-9248-ead93ed7cfe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:25.120769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe68365-ed39-4524-ac09-0835b1156773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:25.121563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68365-ed39-4524-ac09-0835b1156773 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.121854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68365-ed39-4524-ac09-0835b1156773 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.122138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe68365-ed39-4524-ac09-0835b1156773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.145352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe68365-ed39-4524-ac09-0835b1156773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:25.146865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe68365-ed39-4524-ac09-0835b1156773 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:25.190098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 875/1724] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:25.191147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe68365-ed39-4524-ac09-0835b1156773 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:25.233044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe68365-ed39-4524-ac09-0835b1156773 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:25.253773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a2d28-63c7-4116-801d-8e25f8927345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:25.254469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a2d28-63c7-4116-801d-8e25f8927345 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.254756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a2d28-63c7-4116-801d-8e25f8927345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.256354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a2d28-63c7-4116-801d-8e25f8927345 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.257133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a2d28-63c7-4116-801d-8e25f8927345 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:25.264893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336df77-b90e-4ef2-9248-ead93ed7cfe6 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:25.268378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a2d28-63c7-4116-801d-8e25f8927345 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:25.277432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef1a30-032d-4b1d-b2c3-dd9eccd7f2dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:25.278120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef1a30-032d-4b1d-b2c3-dd9eccd7f2dc service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.278406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef1a30-032d-4b1d-b2c3-dd9eccd7f2dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.278693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef1a30-032d-4b1d-b2c3-dd9eccd7f2dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.310008 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 876/1725] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:25.311689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a2d28-63c7-4116-801d-8e25f8927345 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:25.356407 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a2d28-63c7-4116-801d-8e25f8927345 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:25.366502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdaee3-ef52-4612-80cd-cdc032877751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:25.367986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdaee3-ef52-4612-80cd-cdc032877751 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.368284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdaee3-ef52-4612-80cd-cdc032877751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.368567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdaee3-ef52-4612-80cd-cdc032877751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.369317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdaee3-ef52-4612-80cd-cdc032877751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:25.370986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cdaee3-ef52-4612-80cd-cdc032877751 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:25.371883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:25.402192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 877/1726] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:25.402192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdaee3-ef52-4612-80cd-cdc032877751 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:25.427545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef1a30-032d-4b1d-b2c3-dd9eccd7f2dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:25.429571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef1a30-032d-4b1d-b2c3-dd9eccd7f2dc service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:25.435269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdaee3-ef52-4612-80cd-cdc032877751 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:25.444130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 850/1727] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:25.445245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef1a30-032d-4b1d-b2c3-dd9eccd7f2dc service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:25.456570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc90504-e41c-4a69-b989-a65bf31b926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:25.458133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc90504-e41c-4a69-b989-a65bf31b926a admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.458422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc90504-e41c-4a69-b989-a65bf31b926a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.458707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc90504-e41c-4a69-b989-a65bf31b926a admin admin] PATH_INFO: `/v3/projects/8ea21ee527df40c79f18dc6a3bedb66a/users/f9c7f41eb1ae41b789f75898d60f9b7c/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.467464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef1a30-032d-4b1d-b2c3-dd9eccd7f2dc service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:25.478725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d839150b-fe72-4dcc-9aea-f4baf95e17c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:25.479503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839150b-fe72-4dcc-9aea-f4baf95e17c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.479794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839150b-fe72-4dcc-9aea-f4baf95e17c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.480074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d839150b-fe72-4dcc-9aea-f4baf95e17c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.480819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839150b-fe72-4dcc-9aea-f4baf95e17c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:25.483414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d839150b-fe72-4dcc-9aea-f4baf95e17c6 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:25.508379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 851/1728] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:25.508379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb1e5-9332-4488-b529-762a1910f3c2 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.508379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb1e5-9332-4488-b529-762a1910f3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.508379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb1e5-9332-4488-b529-762a1910f3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.524499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc90504-e41c-4a69-b989-a65bf31b926a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea21ee527df40c79f18dc6a3bedb66a, user_id=f9c7f41eb1ae41b789f75898d60f9b7c, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:25.532481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc90504-e41c-4a69-b989-a65bf31b926a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:25.541147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-813bb1e5-9332-4488-b529-762a1910f3c2 None None] MFA Rules not processed for user `9b6716c39cc74e3c8b3949773023c2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:25.542845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-813bb1e5-9332-4488-b529-762a1910f3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:25.559389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 878/1729] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:25 2022] PUT /identity/v3/projects/8ea21ee527df40c79f18dc6a3bedb66a/users/f9c7f41eb1ae41b789f75898d60f9b7c/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:25.560265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc90504-e41c-4a69-b989-a65bf31b926a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:25.647533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 852/1730] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:25.648462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb1e5-9332-4488-b529-762a1910f3c2 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:25.682443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb1e5-9332-4488-b529-762a1910f3c2 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:25.699518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c268174-8081-4642-a900-6b1c4f54f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:25.700204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268174-8081-4642-a900-6b1c4f54f6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.700493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268174-8081-4642-a900-6b1c4f54f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.700956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268174-8081-4642-a900-6b1c4f54f6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.702178 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c268174-8081-4642-a900-6b1c4f54f6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:25.705495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc90504-e41c-4a69-b989-a65bf31b926a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:25.708363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c268174-8081-4642-a900-6b1c4f54f6d5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:25.721937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca386837-43f4-4abf-a730-ceed02754909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:25.723000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca386837-43f4-4abf-a730-ceed02754909 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.723299 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca386837-43f4-4abf-a730-ceed02754909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.723581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca386837-43f4-4abf-a730-ceed02754909 admin admin] PATH_INFO: `/v3/projects/d2d4d9b2a7584877994a6bc511394c9b/users/be9eb26541c543dc9fde9012ef4148bd/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.731239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 853/1731] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:25.732583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707408b9-5f31-4084-a1d4-3268946153a7 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.732877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707408b9-5f31-4084-a1d4-3268946153a7 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.733175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707408b9-5f31-4084-a1d4-3268946153a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.761027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca386837-43f4-4abf-a730-ceed02754909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2d4d9b2a7584877994a6bc511394c9b, user_id=be9eb26541c543dc9fde9012ef4148bd, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:25.764591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca386837-43f4-4abf-a730-ceed02754909 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:25.779170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-707408b9-5f31-4084-a1d4-3268946153a7 None None] MFA Rules not processed for user `9b6716c39cc74e3c8b3949773023c2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:25.780829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-707408b9-5f31-4084-a1d4-3268946153a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:25.804166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 879/1732] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:25 2022] PUT /identity/v3/projects/d2d4d9b2a7584877994a6bc511394c9b/users/be9eb26541c543dc9fde9012ef4148bd/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:25.805366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca386837-43f4-4abf-a730-ceed02754909 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:25.918793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 854/1733] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:25.922006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795e9af-95fa-454a-abf7-a5ac5921c33e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:25.922458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795e9af-95fa-454a-abf7-a5ac5921c33e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:25.922743 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795e9af-95fa-454a-abf7-a5ac5921c33e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:25.982518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7795e9af-95fa-454a-abf7-a5ac5921c33e None None] MFA Rules not processed for user `be9eb26541c543dc9fde9012ef4148bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:25.983772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7795e9af-95fa-454a-abf7-a5ac5921c33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:26.020006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca386837-43f4-4abf-a730-ceed02754909 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:26.040540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b9625-2791-45d6-ad6c-0dff210c5852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:26.044482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9625-2791-45d6-ad6c-0dff210c5852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:26.047863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9625-2791-45d6-ad6c-0dff210c5852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:26.048266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b9625-2791-45d6-ad6c-0dff210c5852 admin admin] PATH_INFO: `/v3/projects/8ea21ee527df40c79f18dc6a3bedb66a/users/f9c7f41eb1ae41b789f75898d60f9b7c/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:26.055980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b9625-2791-45d6-ad6c-0dff210c5852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ea21ee527df40c79f18dc6a3bedb66a, user_id=f9c7f41eb1ae41b789f75898d60f9b7c, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:26.058400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:26.063210 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b9625-2791-45d6-ad6c-0dff210c5852 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:26.095857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:26.112530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 880/1734] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:25 2022] PUT /identity/v3/projects/8ea21ee527df40c79f18dc6a3bedb66a/users/f9c7f41eb1ae41b789f75898d60f9b7c/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:26.126618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b9625-2791-45d6-ad6c-0dff210c5852 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:26.129340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-620b9625-2791-45d6-ad6c-0dff210c5852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:26.140363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 855/1735] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:26.146071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795e9af-95fa-454a-abf7-a5ac5921c33e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:26.153898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7795e9af-95fa-454a-abf7-a5ac5921c33e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:26.203654 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795e9af-95fa-454a-abf7-a5ac5921c33e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:26.284830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b9625-2791-45d6-ad6c-0dff210c5852 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:26.292847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9337f-2466-4bac-a60d-310ff10f4851 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:26.294273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9337f-2466-4bac-a60d-310ff10f4851 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:26.294578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9337f-2466-4bac-a60d-310ff10f4851 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:26.294865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9337f-2466-4bac-a60d-310ff10f4851 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:26.342367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:26.343456 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:26.343843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:26.344127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] PATH_INFO: `/v3/projects/5c999c34af2f406aa643939eee06e690` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:26.346617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c999c34af2f406aa643939eee06e690)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:26.349652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:26.449785 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9337f-2466-4bac-a60d-310ff10f4851 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:26.454760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9337f-2466-4bac-a60d-310ff10f4851 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:26.498236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c999c34af2f406aa643939eee06e690', 'request_id': 'req-0e6f6965-25df-435f-9898-4e0faac54999'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:26.502627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 881/1736] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:26.504833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619227-1ff3-49b8-b8c1-ba673547f3b0 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:26.505145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619227-1ff3-49b8-b8c1-ba673547f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:26.505399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70619227-1ff3-49b8-b8c1-ba673547f3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:26.523663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c999c34af2f406aa643939eee06e690', 'request_id': 'req-0e6f6965-25df-435f-9898-4e0faac54999'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:26.536544 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c999c34af2f406aa643939eee06e690', 'request_id': 'req-0e6f6965-25df-435f-9898-4e0faac54999'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:26.552402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] The token cache is being invalidate because project 5c999c34af2f406aa643939eee06e690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:26.552775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:26.553482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:26.558340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 856/1737] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:26 2022] DELETE /identity/v3/projects/5c999c34af2f406aa643939eee06e690 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:26.558340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:26.558340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:26.633323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-70619227-1ff3-49b8-b8c1-ba673547f3b0 None None] MFA Rules not processed for user `f9c7f41eb1ae41b789f75898d60f9b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:26.636028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-70619227-1ff3-49b8-b8c1-ba673547f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:26.699188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f6965-25df-435f-9898-4e0faac54999 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:26.706934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f600f4-f7ad-496f-9352-326ea76b71a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:26.707958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f600f4-f7ad-496f-9352-326ea76b71a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:26.708386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f600f4-f7ad-496f-9352-326ea76b71a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:26.708810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f600f4-f7ad-496f-9352-326ea76b71a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:26.709678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f600f4-f7ad-496f-9352-326ea76b71a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:26.711782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f600f4-f7ad-496f-9352-326ea76b71a9 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:26.726167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:26.765656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 857/1738] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:26 2022] POST /identity/v3/projects => generated 399 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:26.767129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f600f4-f7ad-496f-9352-326ea76b71a9 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:26.770225 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f7f600f4-f7ad-496f-9352-326ea76b71a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:26.924217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 882/1739] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 421 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:26.944573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145b29-de60-490d-9a91-bb398905aa08 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:26.949973 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145b29-de60-490d-9a91-bb398905aa08 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:26.950561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20145b29-de60-490d-9a91-bb398905aa08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.013276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-20145b29-de60-490d-9a91-bb398905aa08 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:27.024689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-20145b29-de60-490d-9a91-bb398905aa08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:27.038220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f600f4-f7ad-496f-9352-326ea76b71a9 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:27.045117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 883/1740] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:27.046608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20145b29-de60-490d-9a91-bb398905aa08 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:27.047046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:27.048124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.048592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.049028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] PATH_INFO: `/v3/users/7e21e2b825634c3182cd2d6729af43dc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.050547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e21e2b825634c3182cd2d6729af43dc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:27.054074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:27.072988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20145b29-de60-490d-9a91-bb398905aa08 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:27.083482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37985768-8875-4fd5-be88-1e875f136464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:27.084183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37985768-8875-4fd5-be88-1e875f136464 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.084474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37985768-8875-4fd5-be88-1e875f136464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.084757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37985768-8875-4fd5-be88-1e875f136464 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.085466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37985768-8875-4fd5-be88-1e875f136464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:27.095187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37985768-8875-4fd5-be88-1e875f136464 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:27.148225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:27.170998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e21e2b825634c3182cd2d6729af43dc'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:27.171388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e21e2b825634c3182cd2d6729af43dc'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:27.171656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 884/1741] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:27 2022] POST /identity/v3/users => generated 306 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:27.173710 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e21e2b825634c3182cd2d6729af43dc'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:27.173817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37985768-8875-4fd5-be88-1e875f136464 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:27.180056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-37985768-8875-4fd5-be88-1e875f136464 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:27.191911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e21e2b825634c3182cd2d6729af43dc'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:27.213499 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4dc1a844-ef42-43db-8aa8-64b66956fe63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e21e2b825634c3182cd2d6729af43dc'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:27.281243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 858/1742] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:26 2022] DELETE /identity/v3/users/7e21e2b825634c3182cd2d6729af43dc => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:27.282818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f2d2-8d02-4ea9-a327-c97d140d72be None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.284394 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f2d2-8d02-4ea9-a327-c97d140d72be None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.284690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91f2d2-8d02-4ea9-a327-c97d140d72be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.345594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-6f91f2d2-8d02-4ea9-a327-c97d140d72be None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:27.346831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6f91f2d2-8d02-4ea9-a327-c97d140d72be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:27.357324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37985768-8875-4fd5-be88-1e875f136464 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:27.480838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe90839-6d16-4cf1-ba6e-5d38cd935549 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:27.481513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90839-6d16-4cf1-ba6e-5d38cd935549 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.481792 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90839-6d16-4cf1-ba6e-5d38cd935549 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.482064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe90839-6d16-4cf1-ba6e-5d38cd935549 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.484360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7fe90839-6d16-4cf1-ba6e-5d38cd935549 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:27.499361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 859/1743] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:27.502618 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51bde-ae91-4984-885d-9726d91d450a None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.502910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51bde-ae91-4984-885d-9726d91d450a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.503212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced51bde-ae91-4984-885d-9726d91d450a None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.522165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 860/1744] 10.222.0.48 () {54 vars in 961 bytes} [Thu Jul 21 04:18:27 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:27.530921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51bde-ae91-4984-885d-9726d91d450a None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:27.538785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ced51bde-ae91-4984-885d-9726d91d450a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:27.586780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced51bde-ae91-4984-885d-9726d91d450a None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:27.598974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc559bbe-39c3-480a-aa96-49260c9386f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:27.599685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559bbe-39c3-480a-aa96-49260c9386f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.599970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559bbe-39c3-480a-aa96-49260c9386f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.600246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc559bbe-39c3-480a-aa96-49260c9386f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.600990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc559bbe-39c3-480a-aa96-49260c9386f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:27.602710 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc559bbe-39c3-480a-aa96-49260c9386f1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:27.605582 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:27.622562 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 861/1745] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:27.627474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee208f-827a-4803-9f0b-03a162893fca None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.627956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee208f-827a-4803-9f0b-03a162893fca None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.628451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee208f-827a-4803-9f0b-03a162893fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.652131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c3ee208f-827a-4803-9f0b-03a162893fca None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:27.653819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c3ee208f-827a-4803-9f0b-03a162893fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:27.684133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 862/1746] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:27.685161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee208f-827a-4803-9f0b-03a162893fca None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:27.703243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee208f-827a-4803-9f0b-03a162893fca None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:27.715760 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcd9f1-5f01-4e6e-a9e6-028288935e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:27.717071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcd9f1-5f01-4e6e-a9e6-028288935e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.718796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcd9f1-5f01-4e6e-a9e6-028288935e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.718880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcd9f1-5f01-4e6e-a9e6-028288935e39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.719864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcd9f1-5f01-4e6e-a9e6-028288935e39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:27.721132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcd9f1-5f01-4e6e-a9e6-028288935e39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:27.725176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcd9f1-5f01-4e6e-a9e6-028288935e39 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:27.757913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 863/1747] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:27.760218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdc1f4-79f2-4fb9-9618-c65c2d571c74 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.760744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdc1f4-79f2-4fb9-9618-c65c2d571c74 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.761092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbdc1f4-79f2-4fb9-9618-c65c2d571c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.766515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe90839-6d16-4cf1-ba6e-5d38cd935549 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:27.768696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe90839-6d16-4cf1-ba6e-5d38cd935549 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:27.794807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 885/1748] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:27 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:27.820754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe90839-6d16-4cf1-ba6e-5d38cd935549 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:27.842136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1fbdc1f4-79f2-4fb9-9618-c65c2d571c74 None None] MFA Rules not processed for user `8572e4c550014fc4b1aea3ddf16f7d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:27.844968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1fbdc1f4-79f2-4fb9-9618-c65c2d571c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:27.857334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe90839-6d16-4cf1-ba6e-5d38cd935549 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:27.883544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ec22a-9236-46d6-8c3f-263f3954ab1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:27.883544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ec22a-9236-46d6-8c3f-263f3954ab1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.883544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ec22a-9236-46d6-8c3f-263f3954ab1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.883544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ec22a-9236-46d6-8c3f-263f3954ab1a admin admin] PATH_INFO: `/v3/projects/0cb0e9dbe34e4de9a3c8a6b1c94002ec/users/3353385d14cc410aa02cc501965f06bb/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.906477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ec22a-9236-46d6-8c3f-263f3954ab1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb0e9dbe34e4de9a3c8a6b1c94002ec, user_id=3353385d14cc410aa02cc501965f06bb, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:27.909249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ec22a-9236-46d6-8c3f-263f3954ab1a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:27.936960 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 886/1749] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:27 2022] PUT /identity/v3/projects/0cb0e9dbe34e4de9a3c8a6b1c94002ec/users/3353385d14cc410aa02cc501965f06bb/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:27.939860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70efaa3-4155-456b-9fe1-fffd28b15ea5 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:27.940270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70efaa3-4155-456b-9fe1-fffd28b15ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:27.940503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70efaa3-4155-456b-9fe1-fffd28b15ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:27.976400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c70efaa3-4155-456b-9fe1-fffd28b15ea5 None None] MFA Rules not processed for user `94d0ed0857064f368e9f09b434bf93fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:27.977731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c70efaa3-4155-456b-9fe1-fffd28b15ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:28.002256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 864/1750] 10.222.0.48 () {58 vars in 1058 bytes} [Thu Jul 21 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:28.003426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdc1f4-79f2-4fb9-9618-c65c2d571c74 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:28.007711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1fbdc1f4-79f2-4fb9-9618-c65c2d571c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:28.046514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:28.113530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 887/1751] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:28.115006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70efaa3-4155-456b-9fe1-fffd28b15ea5 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:28.165111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbdc1f4-79f2-4fb9-9618-c65c2d571c74 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:28.327465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70efaa3-4155-456b-9fe1-fffd28b15ea5 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:28.343145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c190a-3de6-49e5-b03a-af489fa085ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:28.345113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c190a-3de6-49e5-b03a-af489fa085ed service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:28.345403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c190a-3de6-49e5-b03a-af489fa085ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:28.346165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd863c8-9fa4-4b6b-bddb-ea0464a0fc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:28.348797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd863c8-9fa4-4b6b-bddb-ea0464a0fc2f admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:28.349090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd863c8-9fa4-4b6b-bddb-ea0464a0fc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:28.349374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd863c8-9fa4-4b6b-bddb-ea0464a0fc2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:28.350106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd863c8-9fa4-4b6b-bddb-ea0464a0fc2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:28.352095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd863c8-9fa4-4b6b-bddb-ea0464a0fc2f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:28.353664 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c190a-3de6-49e5-b03a-af489fa085ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:28.386412 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c190a-3de6-49e5-b03a-af489fa085ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:28.388137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c190a-3de6-49e5-b03a-af489fa085ed service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:28.430774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 865/1752] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:28.433175 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43c36b-dce2-48d6-a816-fb7daf0b8948 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:28.433421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43c36b-dce2-48d6-a816-fb7daf0b8948 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:28.433697 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43c36b-dce2-48d6-a816-fb7daf0b8948 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:28.437511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 866/1753] 10.222.0.48 () {54 vars in 912 bytes} [Thu Jul 21 04:18:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:28.443189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 888/1754] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:28 2022] POST /identity/v3/projects => generated 363 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:28.443341 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43c36b-dce2-48d6-a816-fb7daf0b8948 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:28.443519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd863c8-9fa4-4b6b-bddb-ea0464a0fc2f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:28.445034 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fe43c36b-dce2-48d6-a816-fb7daf0b8948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:28.500311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:28.546089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd863c8-9fa4-4b6b-bddb-ea0464a0fc2f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:28.554600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba486836-545c-496a-9d2c-7546f205d694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:28.555709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba486836-545c-496a-9d2c-7546f205d694 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:28.556217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba486836-545c-496a-9d2c-7546f205d694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:28.557201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba486836-545c-496a-9d2c-7546f205d694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:28.558768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba486836-545c-496a-9d2c-7546f205d694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:28.561535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba486836-545c-496a-9d2c-7546f205d694 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:28.578546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43c36b-dce2-48d6-a816-fb7daf0b8948 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:28.582260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 889/1755] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:28.583177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba486836-545c-496a-9d2c-7546f205d694 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:28.588754 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:28.590576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:28.591515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:28.592111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] PATH_INFO: `/v3/users/faca3e985bb4424984cccdd389564ad8` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:28.593935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faca3e985bb4424984cccdd389564ad8)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:28.599346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:28.695942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba486836-545c-496a-9d2c-7546f205d694 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:28.705962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f38f4a1-03b7-4827-8787-0ab5585a9e06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:28.707921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38f4a1-03b7-4827-8787-0ab5585a9e06 service placement] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:28.709696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38f4a1-03b7-4827-8787-0ab5585a9e06 service placement] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:28.710200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f38f4a1-03b7-4827-8787-0ab5585a9e06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:28.715612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faca3e985bb4424984cccdd389564ad8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:28.716528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faca3e985bb4424984cccdd389564ad8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:28.717639 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faca3e985bb4424984cccdd389564ad8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:28.717823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7f38f4a1-03b7-4827-8787-0ab5585a9e06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:28.734391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:28.735503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faca3e985bb4424984cccdd389564ad8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:28.737462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38f4a1-03b7-4827-8787-0ab5585a9e06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:28.742025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f38f4a1-03b7-4827-8787-0ab5585a9e06 service placement] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:28.747261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faca3e985bb4424984cccdd389564ad8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:28.770780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 890/1756] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:28.772382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d957b16-36b8-4ed7-98e0-a89b861c285c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:28.772650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d957b16-36b8-4ed7-98e0-a89b861c285c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:28.772990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d957b16-36b8-4ed7-98e0-a89b861c285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:28.795171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-0d957b16-36b8-4ed7-98e0-a89b861c285c None None] MFA Rules not processed for user `b3b2d5dee6d240558a71331e05035a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:28.797061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0d957b16-36b8-4ed7-98e0-a89b861c285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:28.800957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 867/1757] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:28 2022] DELETE /identity/v3/users/faca3e985bb4424984cccdd389564ad8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:28.801960 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:28.804931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:28.896042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 891/1758] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:18:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:28.899317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d957b16-36b8-4ed7-98e0-a89b861c285c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:28.902572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0d957b16-36b8-4ed7-98e0-a89b861c285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:28.986487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9884d9e9-785f-466b-82f2-fce68532dbb7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:28.999378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aba3174-9e6c-4bea-8020-365625096517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:29.000348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3174-9e6c-4bea-8020-365625096517 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.000831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3174-9e6c-4bea-8020-365625096517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.001916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aba3174-9e6c-4bea-8020-365625096517 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.003106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba3174-9e6c-4bea-8020-365625096517 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:29.006724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aba3174-9e6c-4bea-8020-365625096517 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:29.047638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 868/1759] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:28 2022] POST /identity/v3/users => generated 282 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:29.049574 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd3136-cb6b-4b0d-a56e-919cf9530ccf None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.050150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd3136-cb6b-4b0d-a56e-919cf9530ccf None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.053898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd3136-cb6b-4b0d-a56e-919cf9530ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.078661 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-18cd3136-cb6b-4b0d-a56e-919cf9530ccf None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:29.080605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-18cd3136-cb6b-4b0d-a56e-919cf9530ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:29.086833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d957b16-36b8-4ed7-98e0-a89b861c285c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:29.090273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 869/1760] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:29.091643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd3136-cb6b-4b0d-a56e-919cf9530ccf None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:29.099345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-18cd3136-cb6b-4b0d-a56e-919cf9530ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:29.111872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acc21a-1ad1-4e2d-9747-08c6fa8af414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:29.113016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acc21a-1ad1-4e2d-9747-08c6fa8af414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.113399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acc21a-1ad1-4e2d-9747-08c6fa8af414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.113890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acc21a-1ad1-4e2d-9747-08c6fa8af414 admin admin] PATH_INFO: `/v3/projects/0cb0e9dbe34e4de9a3c8a6b1c94002ec/users/3353385d14cc410aa02cc501965f06bb/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.118126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acc21a-1ad1-4e2d-9747-08c6fa8af414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cb0e9dbe34e4de9a3c8a6b1c94002ec, user_id=3353385d14cc410aa02cc501965f06bb, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:29.120567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd3136-cb6b-4b0d-a56e-919cf9530ccf None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:29.123061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9acc21a-1ad1-4e2d-9747-08c6fa8af414 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:29.125206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a414b4-5715-407f-839e-f527d8989f58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:29.126235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a414b4-5715-407f-839e-f527d8989f58 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.127013 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a414b4-5715-407f-839e-f527d8989f58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.127485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a414b4-5715-407f-839e-f527d8989f58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.140708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a414b4-5715-407f-839e-f527d8989f58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:29.143307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a414b4-5715-407f-839e-f527d8989f58 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:29.155052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 870/1762] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:29.156500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a414b4-5715-407f-839e-f527d8989f58 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:29.165125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 892/1762] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:28 2022] PUT /identity/v3/projects/0cb0e9dbe34e4de9a3c8a6b1c94002ec/users/3353385d14cc410aa02cc501965f06bb/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:29.166219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acc21a-1ad1-4e2d-9747-08c6fa8af414 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:29.195738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a414b4-5715-407f-839e-f527d8989f58 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:29.255180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:29.268828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9acc21a-1ad1-4e2d-9747-08c6fa8af414 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:29.274581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8bcbc-de3a-480c-9d2d-7db1fa65ded0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:29.275574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8bcbc-de3a-480c-9d2d-7db1fa65ded0 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.276006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8bcbc-de3a-480c-9d2d-7db1fa65ded0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.276382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8bcbc-de3a-480c-9d2d-7db1fa65ded0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.355019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4475c-59d4-4445-9a02-65f02ce88bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:29.355779 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4475c-59d4-4445-9a02-65f02ce88bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.356068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4475c-59d4-4445-9a02-65f02ce88bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.357944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4475c-59d4-4445-9a02-65f02ce88bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.358800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4475c-59d4-4445-9a02-65f02ce88bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:29.363596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4475c-59d4-4445-9a02-65f02ce88bbd admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:29.400799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 871/1763] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:29.402428 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c781e9-2b61-4dc2-b047-3d159a1f2103 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.403081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c781e9-2b61-4dc2-b047-3d159a1f2103 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.403081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c781e9-2b61-4dc2-b047-3d159a1f2103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.404450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:29.429935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8bcbc-de3a-480c-9d2d-7db1fa65ded0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:29.434801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8bcbc-de3a-480c-9d2d-7db1fa65ded0 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:29.472048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-23c781e9-2b61-4dc2-b047-3d159a1f2103 None None] MFA Rules not processed for user `3353385d14cc410aa02cc501965f06bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:29.474771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-23c781e9-2b61-4dc2-b047-3d159a1f2103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:29.484014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 893/1764] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:29.485539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8bcbc-de3a-480c-9d2d-7db1fa65ded0 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:29.524141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8bcbc-de3a-480c-9d2d-7db1fa65ded0 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:29.564645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea54bb2-55f8-4e49-9ca7-dbd991a7e264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:29.565478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54bb2-55f8-4e49-9ca7-dbd991a7e264 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.566383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54bb2-55f8-4e49-9ca7-dbd991a7e264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.566828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea54bb2-55f8-4e49-9ca7-dbd991a7e264 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.568190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea54bb2-55f8-4e49-9ca7-dbd991a7e264 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:29.570112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea54bb2-55f8-4e49-9ca7-dbd991a7e264 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:29.602185 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 894/1765] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:29.606630 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea54bb2-55f8-4e49-9ca7-dbd991a7e264 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:29.607998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 872/1766] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:29 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:29.622433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c781e9-2b61-4dc2-b047-3d159a1f2103 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:29.625221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-23c781e9-2b61-4dc2-b047-3d159a1f2103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:29.641262 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea54bb2-55f8-4e49-9ca7-dbd991a7e264 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:29.650585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7fcd4-73ad-4b9c-8cae-5acfe8176987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:29.651629 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7fcd4-73ad-4b9c-8cae-5acfe8176987 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.651978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7fcd4-73ad-4b9c-8cae-5acfe8176987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.652464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7fcd4-73ad-4b9c-8cae-5acfe8176987 admin admin] PATH_INFO: `/v3/projects/e5d2e5c69a7c4762a7ccd7e8096baf81/users/2b6efe1a4da84d43addca3ca393cf594/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.699044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7fcd4-73ad-4b9c-8cae-5acfe8176987 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5d2e5c69a7c4762a7ccd7e8096baf81, user_id=2b6efe1a4da84d43addca3ca393cf594, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:29.705068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7fcd4-73ad-4b9c-8cae-5acfe8176987 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:29.747776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 895/1767] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:29 2022] PUT /identity/v3/projects/e5d2e5c69a7c4762a7ccd7e8096baf81/users/2b6efe1a4da84d43addca3ca393cf594/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:29.760078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b622-731b-4bef-8ddb-1a6198731240 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.766165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b622-731b-4bef-8ddb-1a6198731240 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.766643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9423b622-731b-4bef-8ddb-1a6198731240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:29.820364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c781e9-2b61-4dc2-b047-3d159a1f2103 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:29.833277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-9423b622-731b-4bef-8ddb-1a6198731240 None None] MFA Rules not processed for user `2b6efe1a4da84d43addca3ca393cf594`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:29.834590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9423b622-731b-4bef-8ddb-1a6198731240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:29.961985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8214e-29f3-4250-9950-44f274808943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:29.962710 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8214e-29f3-4250-9950-44f274808943 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:29.965999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8214e-29f3-4250-9950-44f274808943 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:29.966324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb8214e-29f3-4250-9950-44f274808943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:30.013072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:30.042063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 896/1768] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:29 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:30.046717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b622-731b-4bef-8ddb-1a6198731240 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:30.051600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9423b622-731b-4bef-8ddb-1a6198731240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:30.206033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8214e-29f3-4250-9950-44f274808943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:30.216676 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb8214e-29f3-4250-9950-44f274808943 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:30.259523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9423b622-731b-4bef-8ddb-1a6198731240 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:30.260633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 873/1769] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:29 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:30.262347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8214e-29f3-4250-9950-44f274808943 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:30.268709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:30.270249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:30.270533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:30.270809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] PATH_INFO: `/v3/projects/59cc42e3aea448f7a49ef19b801a4f72` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:30.277072 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cc42e3aea448f7a49ef19b801a4f72)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:30.292006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:30.293594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb8214e-29f3-4250-9950-44f274808943 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:30.355995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6c560-20b3-45a4-a921-eba0403566ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:30.357791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6c560-20b3-45a4-a921-eba0403566ed admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:30.358196 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6c560-20b3-45a4-a921-eba0403566ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:30.363520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6c560-20b3-45a4-a921-eba0403566ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:30.364551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6c560-20b3-45a4-a921-eba0403566ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:30.374644 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa6c560-20b3-45a4-a921-eba0403566ed admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:30.447754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:30.452864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cc42e3aea448f7a49ef19b801a4f72', 'request_id': 'req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:30.467141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cc42e3aea448f7a49ef19b801a4f72', 'request_id': 'req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:30.469973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 874/1770] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:30 2022] POST /identity/v3/projects => generated 365 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:30.471407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6c560-20b3-45a4-a921-eba0403566ed admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:30.502433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cc42e3aea448f7a49ef19b801a4f72', 'request_id': 'req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:30.525161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] The token cache is being invalidate because project 59cc42e3aea448f7a49ef19b801a4f72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:30.525748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:30.527688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:30.533186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 897/1771] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:30 2022] DELETE /identity/v3/projects/59cc42e3aea448f7a49ef19b801a4f72 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:30.533186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:30.534770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:30.653747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0fb68-4ffe-4957-8b8f-ca78fbfc2a89 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:30.702476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6c560-20b3-45a4-a921-eba0403566ed admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:30.710888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39786867-97e0-466b-b232-5fabd3059888 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:30.711990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39786867-97e0-466b-b232-5fabd3059888 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:30.712390 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39786867-97e0-466b-b232-5fabd3059888 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:30.712789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39786867-97e0-466b-b232-5fabd3059888 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:30.726579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-39786867-97e0-466b-b232-5fabd3059888 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:30.808388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17e94d-2af4-414a-abd0-9cfcb6f25356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:30.811119 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17e94d-2af4-414a-abd0-9cfcb6f25356 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:30.812329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17e94d-2af4-414a-abd0-9cfcb6f25356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:30.814003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17e94d-2af4-414a-abd0-9cfcb6f25356 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:30.819166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17e94d-2af4-414a-abd0-9cfcb6f25356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:30.827070 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17e94d-2af4-414a-abd0-9cfcb6f25356 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:30.896437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 898/1772] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:30 2022] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:30.897632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17e94d-2af4-414a-abd0-9cfcb6f25356 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:30.901616 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6e17e94d-2af4-414a-abd0-9cfcb6f25356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:30.929533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17e94d-2af4-414a-abd0-9cfcb6f25356 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:30.937105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:30.937348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39786867-97e0-466b-b232-5fabd3059888 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:30.938268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:30.939018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:30.939312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39786867-97e0-466b-b232-5fabd3059888 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:30.939478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] PATH_INFO: `/v3/users/345a3af62cd44745be974ac74634dd52` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:30.942441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=345a3af62cd44745be974ac74634dd52)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:30.945975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:30.996889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 875/1773] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:30 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:30.997585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39786867-97e0-466b-b232-5fabd3059888 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:31.037690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39786867-97e0-466b-b232-5fabd3059888 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:31.058791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c67953-b63f-4a39-8bf4-353c5e737b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:31.059639 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c67953-b63f-4a39-8bf4-353c5e737b4e admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.059925 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c67953-b63f-4a39-8bf4-353c5e737b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.060207 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c67953-b63f-4a39-8bf4-353c5e737b4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.061815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c67953-b63f-4a39-8bf4-353c5e737b4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:31.069008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c67953-b63f-4a39-8bf4-353c5e737b4e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:31.108514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345a3af62cd44745be974ac74634dd52'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.109303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345a3af62cd44745be974ac74634dd52'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.110164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345a3af62cd44745be974ac74634dd52'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.111530 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 876/1774] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:31.127192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c67953-b63f-4a39-8bf4-353c5e737b4e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:31.131920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-19c67953-b63f-4a39-8bf4-353c5e737b4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:31.142190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345a3af62cd44745be974ac74634dd52'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.150655 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c67953-b63f-4a39-8bf4-353c5e737b4e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:31.165332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:31.167209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.167636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.168046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] PATH_INFO: `/v3/projects/0e3ed71124614f9a9002ee3765e922bc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.169869 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e3ed71124614f9a9002ee3765e922bc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:31.172634 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:31.176805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-2b170557-8041-494d-b12d-6abe54f8ff0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345a3af62cd44745be974ac74634dd52'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.185216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:DELETE=12,keystone:SELECT=83,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:31.253339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 899/1775] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:30 2022] DELETE /identity/v3/users/345a3af62cd44745be974ac74634dd52 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:31.255210 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f862348-ad52-4f7e-8346-d1a7e0604975 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.255783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f862348-ad52-4f7e-8346-d1a7e0604975 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.273658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:31.291729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f862348-ad52-4f7e-8346-d1a7e0604975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.314798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e3ed71124614f9a9002ee3765e922bc', 'request_id': 'req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.329933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e3ed71124614f9a9002ee3765e922bc', 'request_id': 'req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.340317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e3ed71124614f9a9002ee3765e922bc', 'request_id': 'req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.360945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] The token cache is being invalidate because project 0e3ed71124614f9a9002ee3765e922bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:31.360945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.361475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:31.366091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 877/1776] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:31 2022] DELETE /identity/v3/projects/0e3ed71124614f9a9002ee3765e922bc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:31.372350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:31.374278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:31.416098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2f862348-ad52-4f7e-8346-d1a7e0604975 None None] MFA Rules not processed for user `9b6716c39cc74e3c8b3949773023c2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:31.425939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2f862348-ad52-4f7e-8346-d1a7e0604975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:31.489077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa28fd7-2d17-4ffa-a37c-8047c13e467c admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:31.512882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f38f3-6bc7-4a99-ab46-82f639b5f459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:31.513649 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f38f3-6bc7-4a99-ab46-82f639b5f459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.513916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f38f3-6bc7-4a99-ab46-82f639b5f459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.515197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f38f3-6bc7-4a99-ab46-82f639b5f459 admin admin] PATH_INFO: `/v3/projects/2990b83a0c2145939060a2ccef175b6e/users/d29ac00bb05d456d9c63ee02385f93a3/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.559230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f38f3-6bc7-4a99-ab46-82f639b5f459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2990b83a0c2145939060a2ccef175b6e, user_id=d29ac00bb05d456d9c63ee02385f93a3, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:31.563317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f38f3-6bc7-4a99-ab46-82f639b5f459 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:31.601576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 878/1777] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:31 2022] PUT /identity/v3/projects/2990b83a0c2145939060a2ccef175b6e/users/d29ac00bb05d456d9c63ee02385f93a3/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:31.603573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f38f3-6bc7-4a99-ab46-82f639b5f459 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:31.608237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-202f38f3-6bc7-4a99-ab46-82f639b5f459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:31.767484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 900/1778] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:31.772957 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f862348-ad52-4f7e-8346-d1a7e0604975 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:31.799854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f38f3-6bc7-4a99-ab46-82f639b5f459 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:31.821209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f862348-ad52-4f7e-8346-d1a7e0604975 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:31.833901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb2c7e-2995-4e1a-b2aa-95c2392ddd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:31.834753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb2c7e-2995-4e1a-b2aa-95c2392ddd18 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.835186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb2c7e-2995-4e1a-b2aa-95c2392ddd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.835606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbb2c7e-2995-4e1a-b2aa-95c2392ddd18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.836454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb2c7e-2995-4e1a-b2aa-95c2392ddd18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:31.842375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbb2c7e-2995-4e1a-b2aa-95c2392ddd18 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:31.845330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:31.846246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.846556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.857192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] PATH_INFO: `/v3/users/f9c7f41eb1ae41b789f75898d60f9b7c` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.860149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9c7f41eb1ae41b789f75898d60f9b7c)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:31.862042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:31.874884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 901/1779] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:31.883473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb2c7e-2995-4e1a-b2aa-95c2392ddd18 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:31.910518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbb2c7e-2995-4e1a-b2aa-95c2392ddd18 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:31.918352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a642e-456d-4c78-8840-5c5c007d6cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:31.919505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a642e-456d-4c78-8840-5c5c007d6cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.919892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a642e-456d-4c78-8840-5c5c007d6cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.920239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a642e-456d-4c78-8840-5c5c007d6cd5 admin admin] PATH_INFO: `/v3/projects/2990b83a0c2145939060a2ccef175b6e/users/d29ac00bb05d456d9c63ee02385f93a3/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:31.923617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a642e-456d-4c78-8840-5c5c007d6cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2990b83a0c2145939060a2ccef175b6e, user_id=d29ac00bb05d456d9c63ee02385f93a3, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:31.927860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a642e-456d-4c78-8840-5c5c007d6cd5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:31.949763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 902/1780] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:31 2022] PUT /identity/v3/projects/2990b83a0c2145939060a2ccef175b6e/users/d29ac00bb05d456d9c63ee02385f93a3/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:31.961090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c170e-8357-4c63-86b4-ca9ef85de584 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:31.961707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c170e-8357-4c63-86b4-ca9ef85de584 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:31.962094 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c170e-8357-4c63-86b4-ca9ef85de584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:32.017267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:32.053617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9c7f41eb1ae41b789f75898d60f9b7c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.057067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9c7f41eb1ae41b789f75898d60f9b7c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.067737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9c7f41eb1ae41b789f75898d60f9b7c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.089144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9c7f41eb1ae41b789f75898d60f9b7c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.104676 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9c7f41eb1ae41b789f75898d60f9b7c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.106063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-4c0c170e-8357-4c63-86b4-ca9ef85de584 None None] MFA Rules not processed for user `d29ac00bb05d456d9c63ee02385f93a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:32.108972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4c0c170e-8357-4c63-86b4-ca9ef85de584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.136060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 879/1781] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:31 2022] DELETE /identity/v3/users/f9c7f41eb1ae41b789f75898d60f9b7c => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:32.345630 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 903/1782] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:32.354876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:32.362014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.366580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c170e-8357-4c63-86b4-ca9ef85de584 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:32.368728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4c0c170e-8357-4c63-86b4-ca9ef85de584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.515875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:32.535199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c170e-8357-4c63-86b4-ca9ef85de584 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:32.539792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd85e77-8976-4ce5-9e23-2207148403d1 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:32.547939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:32.549088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:32.549383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:32.549796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] PATH_INFO: `/v3/projects/509619aaa8fe4a26816e5832872f4554` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:32.552291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509619aaa8fe4a26816e5832872f4554)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:32.566515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:32.630742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b2fbd8-cb35-42d4-9f37-25caae90c156 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:32.631371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2fbd8-cb35-42d4-9f37-25caae90c156 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:32.631660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2fbd8-cb35-42d4-9f37-25caae90c156 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:32.631944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b2fbd8-cb35-42d4-9f37-25caae90c156 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:32.679454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509619aaa8fe4a26816e5832872f4554', 'request_id': 'req-064028e9-9757-47cf-9c78-753a92a66546'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.705516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509619aaa8fe4a26816e5832872f4554', 'request_id': 'req-064028e9-9757-47cf-9c78-753a92a66546'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.721556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509619aaa8fe4a26816e5832872f4554', 'request_id': 'req-064028e9-9757-47cf-9c78-753a92a66546'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.738497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2fbd8-cb35-42d4-9f37-25caae90c156 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:32.740178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b2fbd8-cb35-42d4-9f37-25caae90c156 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:32.740399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] The token cache is being invalidate because project 509619aaa8fe4a26816e5832872f4554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:32.740643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.741406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-064028e9-9757-47cf-9c78-753a92a66546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:32.744412 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 880/1783] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:32 2022] DELETE /identity/v3/projects/509619aaa8fe4a26816e5832872f4554 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:32.748434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef7d79-9d39-460f-9d0e-24e477a9576e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:32.748970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef7d79-9d39-460f-9d0e-24e477a9576e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:32.749259 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef7d79-9d39-460f-9d0e-24e477a9576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:32.752914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 904/1784] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:32.778296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d3ef7d79-9d39-460f-9d0e-24e477a9576e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:32.779740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d3ef7d79-9d39-460f-9d0e-24e477a9576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.839718 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:32.873841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 881/1785] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:32.882493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83352e23-207a-4e61-8384-2f42e9b32e8c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:32.882923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83352e23-207a-4e61-8384-2f42e9b32e8c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:32.883435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83352e23-207a-4e61-8384-2f42e9b32e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:32.924823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-83352e23-207a-4e61-8384-2f42e9b32e8c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:32.929055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-83352e23-207a-4e61-8384-2f42e9b32e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.946005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef7d79-9d39-460f-9d0e-24e477a9576e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:32.947525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d3ef7d79-9d39-460f-9d0e-24e477a9576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:32.974534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 905/1786] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:33.006142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83352e23-207a-4e61-8384-2f42e9b32e8c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:33.062234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83352e23-207a-4e61-8384-2f42e9b32e8c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:33.080273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94efc73-06e5-4caa-ac87-c9b4ca71e02c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:33.081752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efc73-06e5-4caa-ac87-c9b4ca71e02c admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:33.082258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efc73-06e5-4caa-ac87-c9b4ca71e02c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:33.082769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94efc73-06e5-4caa-ac87-c9b4ca71e02c admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:33.083755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94efc73-06e5-4caa-ac87-c9b4ca71e02c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:33.085473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94efc73-06e5-4caa-ac87-c9b4ca71e02c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:33.088974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94efc73-06e5-4caa-ac87-c9b4ca71e02c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:33.159290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 906/1787] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:33.162508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6dda5-4566-487d-985d-addf5685fb10 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:33.172901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6dda5-4566-487d-985d-addf5685fb10 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:33.173447 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b6dda5-4566-487d-985d-addf5685fb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:33.199376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef7d79-9d39-460f-9d0e-24e477a9576e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:33.216299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4eab5-e2d8-47f6-8647-9126998c14fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:33.218444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4eab5-e2d8-47f6-8647-9126998c14fd service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:33.218734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4eab5-e2d8-47f6-8647-9126998c14fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:33.219085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4eab5-e2d8-47f6-8647-9126998c14fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:33.223783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a7e4eab5-e2d8-47f6-8647-9126998c14fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:33.384037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-14b6dda5-4566-487d-985d-addf5685fb10 None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:33.385259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-14b6dda5-4566-487d-985d-addf5685fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:33.395183 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4eab5-e2d8-47f6-8647-9126998c14fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:33.396661 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4eab5-e2d8-47f6-8647-9126998c14fd service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:33.431460 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 882/1788] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:33.432673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4eab5-e2d8-47f6-8647-9126998c14fd service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:33.489486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4eab5-e2d8-47f6-8647-9126998c14fd service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:33.513837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73af96b-e266-4242-9ae8-ad9f75c76b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:33.516585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73af96b-e266-4242-9ae8-ad9f75c76b38 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:33.519437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73af96b-e266-4242-9ae8-ad9f75c76b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:33.519941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73af96b-e266-4242-9ae8-ad9f75c76b38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:33.524060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73af96b-e266-4242-9ae8-ad9f75c76b38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:33.529945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73af96b-e266-4242-9ae8-ad9f75c76b38 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:33.620109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 883/1789] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:33 2022] POST /identity/v3/projects => generated 357 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:33.624796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73af96b-e266-4242-9ae8-ad9f75c76b38 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:33.648814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 907/1790] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:18:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 488 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:33.729674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6dda5-4566-487d-985d-addf5685fb10 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:33.731392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-14b6dda5-4566-487d-985d-addf5685fb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:33.764734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b6dda5-4566-487d-985d-addf5685fb10 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:33.774113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:33.907561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:33.911324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:33.911634 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:33.911907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] PATH_INFO: `/v3/projects/8ea21ee527df40c79f18dc6a3bedb66a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:33.915208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ea21ee527df40c79f18dc6a3bedb66a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:33.920132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:33.957210 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73af96b-e266-4242-9ae8-ad9f75c76b38 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:33.981415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bdaac-e31f-4e5f-90b5-0c1a5d0a2925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:33.982099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdaac-e31f-4e5f-90b5-0c1a5d0a2925 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:33.982519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdaac-e31f-4e5f-90b5-0c1a5d0a2925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:33.982798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8bdaac-e31f-4e5f-90b5-0c1a5d0a2925 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:33.989016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bdaac-e31f-4e5f-90b5-0c1a5d0a2925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:34.004579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8bdaac-e31f-4e5f-90b5-0c1a5d0a2925 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:34.054528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ea21ee527df40c79f18dc6a3bedb66a', 'request_id': 'req-29d83ae0-4f33-420c-915e-9aa43f0aa94e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:34.075482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ea21ee527df40c79f18dc6a3bedb66a', 'request_id': 'req-29d83ae0-4f33-420c-915e-9aa43f0aa94e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:34.076883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 884/1791] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:33 2022] POST /identity/v3/users => generated 279 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:34.080253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bdaac-e31f-4e5f-90b5-0c1a5d0a2925 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:34.084195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0e8bdaac-e31f-4e5f-90b5-0c1a5d0a2925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:34.087894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ea21ee527df40c79f18dc6a3bedb66a', 'request_id': 'req-29d83ae0-4f33-420c-915e-9aa43f0aa94e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:34.111869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] The token cache is being invalidate because project 8ea21ee527df40c79f18dc6a3bedb66a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:34.112171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:34.115995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:34.118695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 908/1792] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:33 2022] DELETE /identity/v3/projects/8ea21ee527df40c79f18dc6a3bedb66a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:34.121388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:34.122378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:34.124693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:34.332740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d83ae0-4f33-420c-915e-9aa43f0aa94e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:34.350329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cc5819-634c-4c1c-9805-5f146a35b4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:34.351374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc5819-634c-4c1c-9805-5f146a35b4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.351830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc5819-634c-4c1c-9805-5f146a35b4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.352558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cc5819-634c-4c1c-9805-5f146a35b4e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.353443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc5819-634c-4c1c-9805-5f146a35b4e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:34.356203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cc5819-634c-4c1c-9805-5f146a35b4e8 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:34.391694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 909/1793] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:34.395115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecdfbc-5214-4cda-81dc-50fb70bb9803 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.395336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecdfbc-5214-4cda-81dc-50fb70bb9803 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.397775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ecdfbc-5214-4cda-81dc-50fb70bb9803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.421651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8bdaac-e31f-4e5f-90b5-0c1a5d0a2925 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:34.462520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-59ecdfbc-5214-4cda-81dc-50fb70bb9803 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:34.467838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-59ecdfbc-5214-4cda-81dc-50fb70bb9803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:34.487012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 910/1794] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:34.488267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecdfbc-5214-4cda-81dc-50fb70bb9803 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:34.511171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ecdfbc-5214-4cda-81dc-50fb70bb9803 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:34.523091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a3502-6ba9-4945-a06d-302b12e6e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:34.523964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a3502-6ba9-4945-a06d-302b12e6e900 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.524253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a3502-6ba9-4945-a06d-302b12e6e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.528461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a3502-6ba9-4945-a06d-302b12e6e900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.529963 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a3502-6ba9-4945-a06d-302b12e6e900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:34.544868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a3502-6ba9-4945-a06d-302b12e6e900 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:34.591358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 911/1795] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:34 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:34.593933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece9ee6-1bfc-44a1-a1ef-a73ca5a49689 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.594228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece9ee6-1bfc-44a1-a1ef-a73ca5a49689 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.594514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eece9ee6-1bfc-44a1-a1ef-a73ca5a49689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.613510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad3ef3-7b00-4e37-8845-401779df8b7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:34.616259 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad3ef3-7b00-4e37-8845-401779df8b7f service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.619241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad3ef3-7b00-4e37-8845-401779df8b7f service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.622519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad3ef3-7b00-4e37-8845-401779df8b7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.624361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-eece9ee6-1bfc-44a1-a1ef-a73ca5a49689 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:34.626564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-73ad3ef3-7b00-4e37-8845-401779df8b7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:34.631979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-eece9ee6-1bfc-44a1-a1ef-a73ca5a49689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:34.643679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 912/1796] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:34.644790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece9ee6-1bfc-44a1-a1ef-a73ca5a49689 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:34.668680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eece9ee6-1bfc-44a1-a1ef-a73ca5a49689 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:34.687486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1cdcfd-3ed8-4bea-846d-384b4e7522a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:34.692583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cdcfd-3ed8-4bea-846d-384b4e7522a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.692881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cdcfd-3ed8-4bea-846d-384b4e7522a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.693174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1cdcfd-3ed8-4bea-846d-384b4e7522a3 admin admin] PATH_INFO: `/v3/projects/e65274e20c894362ae02ab575afb4b67/users/f7bda4732778446193e6da90f8abf341/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.709523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:34.753962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cdcfd-3ed8-4bea-846d-384b4e7522a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e65274e20c894362ae02ab575afb4b67, user_id=f7bda4732778446193e6da90f8abf341, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:34.756731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1cdcfd-3ed8-4bea-846d-384b4e7522a3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:34.799335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad3ef3-7b00-4e37-8845-401779df8b7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:34.802493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ad3ef3-7b00-4e37-8845-401779df8b7f service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:34.815940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 885/1797] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:18:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:18:34.816913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad3ef3-7b00-4e37-8845-401779df8b7f service swift] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:34.818146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 913/1798] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:34 2022] PUT /identity/v3/projects/e65274e20c894362ae02ab575afb4b67/users/f7bda4732778446193e6da90f8abf341/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:34.830887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ad3ef3-7b00-4e37-8845-401779df8b7f service swift] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:34.832128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8be9-784e-4c36-b15d-12a52c71a0e9 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.832128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8be9-784e-4c36-b15d-12a52c71a0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.832128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe8be9-784e-4c36-b15d-12a52c71a0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.871128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:34.908807 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407d943-d8c2-404c-9805-03f59aac6975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:34.920489 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407d943-d8c2-404c-9805-03f59aac6975 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.923472 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407d943-d8c2-404c-9805-03f59aac6975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.924397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c407d943-d8c2-404c-9805-03f59aac6975 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.926237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407d943-d8c2-404c-9805-03f59aac6975 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:34.926656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407d943-d8c2-404c-9805-03f59aac6975 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:34.930222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-0dfe8be9-784e-4c36-b15d-12a52c71a0e9 None None] MFA Rules not processed for user `f7bda4732778446193e6da90f8abf341`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:34.931521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0dfe8be9-784e-4c36-b15d-12a52c71a0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:34.937304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c407d943-d8c2-404c-9805-03f59aac6975 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:34.963454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 886/1799] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:34.968082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407d943-d8c2-404c-9805-03f59aac6975 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:34.981008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c407d943-d8c2-404c-9805-03f59aac6975 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:34.992011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5348c-512d-41b4-bc95-2dd312adb01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:34.994475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5348c-512d-41b4-bc95-2dd312adb01c admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:34.995515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5348c-512d-41b4-bc95-2dd312adb01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:34.996583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5348c-512d-41b4-bc95-2dd312adb01c admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:34.998840 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5348c-512d-41b4-bc95-2dd312adb01c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:35.004296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5348c-512d-41b4-bc95-2dd312adb01c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:35.089543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 887/1800] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:34 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:35.093432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5348c-512d-41b4-bc95-2dd312adb01c admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.235323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 914/1801] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:34 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:35.236433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8be9-784e-4c36-b15d-12a52c71a0e9 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.292740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe8be9-784e-4c36-b15d-12a52c71a0e9 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:35.374021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5348c-512d-41b4-bc95-2dd312adb01c admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:35.389631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12949-5552-4a91-9d22-5e763ae867a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:35.392578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12949-5552-4a91-9d22-5e763ae867a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:35.398075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12949-5552-4a91-9d22-5e763ae867a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:35.398913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe12949-5552-4a91-9d22-5e763ae867a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:35.401198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe12949-5552-4a91-9d22-5e763ae867a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:35.405681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe12949-5552-4a91-9d22-5e763ae867a9 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:35.506227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 888/1802] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:35 2022] POST /identity/v3/users => generated 294 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:35.511938 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12949-5552-4a91-9d22-5e763ae867a9 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.551764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe12949-5552-4a91-9d22-5e763ae867a9 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:35.573029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6290227-eaa5-41e0-a3d0-2c279a69c903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:35.577879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6290227-eaa5-41e0-a3d0-2c279a69c903 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:35.578308 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6290227-eaa5-41e0-a3d0-2c279a69c903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:35.579124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6290227-eaa5-41e0-a3d0-2c279a69c903 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:35.579621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623629fb-e166-478c-b58a-1e18d07a0b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:35.580772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6290227-eaa5-41e0-a3d0-2c279a69c903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:35.583432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623629fb-e166-478c-b58a-1e18d07a0b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:35.584503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623629fb-e166-478c-b58a-1e18d07a0b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:35.586688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623629fb-e166-478c-b58a-1e18d07a0b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:35.587943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6290227-eaa5-41e0-a3d0-2c279a69c903 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:35.588390 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623629fb-e166-478c-b58a-1e18d07a0b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:35.594700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623629fb-e166-478c-b58a-1e18d07a0b65 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:35.653922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 889/1803] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:35.658788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6290227-eaa5-41e0-a3d0-2c279a69c903 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.700913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6290227-eaa5-41e0-a3d0-2c279a69c903 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:35.724208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 915/1804] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:35 2022] POST /identity/v3/projects => generated 355 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:35.727945 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623629fb-e166-478c-b58a-1e18d07a0b65 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.739706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970930-dbab-4d87-baaf-e58534726413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:35.740472 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970930-dbab-4d87-baaf-e58534726413 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:35.740754 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970930-dbab-4d87-baaf-e58534726413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:35.741037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba970930-dbab-4d87-baaf-e58534726413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:35.741784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba970930-dbab-4d87-baaf-e58534726413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:35.743453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba970930-dbab-4d87-baaf-e58534726413 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:35.801634 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 890/1805] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:35.802598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970930-dbab-4d87-baaf-e58534726413 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:35.842315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba970930-dbab-4d87-baaf-e58534726413 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:35.963230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623629fb-e166-478c-b58a-1e18d07a0b65 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:35.978325 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba48dda-3781-4acc-8906-919d732bb603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:35.979354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba48dda-3781-4acc-8906-919d732bb603 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:35.979792 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba48dda-3781-4acc-8906-919d732bb603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:35.980077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba48dda-3781-4acc-8906-919d732bb603 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:35.980981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba48dda-3781-4acc-8906-919d732bb603 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:35.985653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba48dda-3781-4acc-8906-919d732bb603 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.004620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:36.059700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 916/1806] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:35 2022] POST /identity/v3/users => generated 284 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:36.062767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba48dda-3781-4acc-8906-919d732bb603 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.069206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c3ff96-1c7a-45b9-b05a-6a77990cee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.070537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3ff96-1c7a-45b9-b05a-6a77990cee8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.071959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3ff96-1c7a-45b9-b05a-6a77990cee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.072399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c3ff96-1c7a-45b9-b05a-6a77990cee8d admin admin] PATH_INFO: `/v3/projects/fcece772f63c4346a275e4be77ac7642/users/b822a810377b4cb08ec617a0930acf6f/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.098347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3ff96-1c7a-45b9-b05a-6a77990cee8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcece772f63c4346a275e4be77ac7642, user_id=b822a810377b4cb08ec617a0930acf6f, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.108201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba48dda-3781-4acc-8906-919d732bb603 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.108834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c3ff96-1c7a-45b9-b05a-6a77990cee8d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.127590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:36.127823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307ceb9-f7ec-4618-92f1-1a6aaa86469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.129537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307ceb9-f7ec-4618-92f1-1a6aaa86469d admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.129537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307ceb9-f7ec-4618-92f1-1a6aaa86469d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.129732 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0307ceb9-f7ec-4618-92f1-1a6aaa86469d admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.131277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307ceb9-f7ec-4618-92f1-1a6aaa86469d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.139563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0307ceb9-f7ec-4618-92f1-1a6aaa86469d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.162989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 891/1807] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:35 2022] PUT /identity/v3/projects/fcece772f63c4346a275e4be77ac7642/users/b822a810377b4cb08ec617a0930acf6f/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:36.170517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784e4a4-597f-40c7-9818-d7071b2402fa None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.170891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784e4a4-597f-40c7-9818-d7071b2402fa None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.171620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784e4a4-597f-40c7-9818-d7071b2402fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.194528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 917/1808] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:36.200024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307ceb9-f7ec-4618-92f1-1a6aaa86469d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.239344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7784e4a4-597f-40c7-9818-d7071b2402fa None None] MFA Rules not processed for user `b822a810377b4cb08ec617a0930acf6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:36.239889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7784e4a4-597f-40c7-9818-d7071b2402fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:36.252595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0307ceb9-f7ec-4618-92f1-1a6aaa86469d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.396772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 892/1809] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:36.401442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784e4a4-597f-40c7-9818-d7071b2402fa None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.433432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcef48-1338-4958-9bd1-efad33ba739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.435187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcef48-1338-4958-9bd1-efad33ba739c admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.435710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcef48-1338-4958-9bd1-efad33ba739c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.436882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcef48-1338-4958-9bd1-efad33ba739c admin admin] PATH_INFO: `/v3/projects/e5b266c7f71f4d1296ffb932a26e23a8/users/843fa354bc424844aa8ec3b52befe0a8/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.459987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcef48-1338-4958-9bd1-efad33ba739c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b266c7f71f4d1296ffb932a26e23a8, user_id=843fa354bc424844aa8ec3b52befe0a8, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.467503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bcef48-1338-4958-9bd1-efad33ba739c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.489737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 918/1810] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:36 2022] PUT /identity/v3/projects/e5b266c7f71f4d1296ffb932a26e23a8/users/843fa354bc424844aa8ec3b52befe0a8/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:36.494648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcef48-1338-4958-9bd1-efad33ba739c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.568063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784e4a4-597f-40c7-9818-d7071b2402fa None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.669052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcef48-1338-4958-9bd1-efad33ba739c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.683179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc36b3-4f02-42d2-9d8b-2478a109bebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.684271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc36b3-4f02-42d2-9d8b-2478a109bebe admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.684618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc36b3-4f02-42d2-9d8b-2478a109bebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.685032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dc36b3-4f02-42d2-9d8b-2478a109bebe admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.685830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc36b3-4f02-42d2-9d8b-2478a109bebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.691423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dc36b3-4f02-42d2-9d8b-2478a109bebe admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.732369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 919/1811] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:36 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:36.733659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc36b3-4f02-42d2-9d8b-2478a109bebe admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.786849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32cb8c-cee4-40d4-b1de-9bd803280142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.789628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32cb8c-cee4-40d4-b1de-9bd803280142 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.789931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32cb8c-cee4-40d4-b1de-9bd803280142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.790276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32cb8c-cee4-40d4-b1de-9bd803280142 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.790853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dc36b3-4f02-42d2-9d8b-2478a109bebe admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:36.795771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32cb8c-cee4-40d4-b1de-9bd803280142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.808363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32cb8c-cee4-40d4-b1de-9bd803280142 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.819489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e1f6a-d5e3-4445-abaf-e14af8ebd623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:36.823345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e1f6a-d5e3-4445-abaf-e14af8ebd623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.823842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e1f6a-d5e3-4445-abaf-e14af8ebd623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.826606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e1f6a-d5e3-4445-abaf-e14af8ebd623 admin admin] PATH_INFO: `/v3/projects/e5b266c7f71f4d1296ffb932a26e23a8/users/843fa354bc424844aa8ec3b52befe0a8/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.840157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e1f6a-d5e3-4445-abaf-e14af8ebd623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b266c7f71f4d1296ffb932a26e23a8, user_id=843fa354bc424844aa8ec3b52befe0a8, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:36.849854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e1f6a-d5e3-4445-abaf-e14af8ebd623 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:36.875590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 893/1812] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:36 2022] POST /identity/v3/projects => generated 387 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:36.882614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32cb8c-cee4-40d4-b1de-9bd803280142 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:36.883392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 920/1813] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:36 2022] PUT /identity/v3/projects/e5b266c7f71f4d1296ffb932a26e23a8/users/843fa354bc424844aa8ec3b52befe0a8/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:36.895255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4941f-1829-4c8a-9519-bcc42a7ee050 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:36.895721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4941f-1829-4c8a-9519-bcc42a7ee050 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:36.896112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4941f-1829-4c8a-9519-bcc42a7ee050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:36.937441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:37.000505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-3af4941f-1829-4c8a-9519-bcc42a7ee050 None None] MFA Rules not processed for user `843fa354bc424844aa8ec3b52befe0a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:37.006725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3af4941f-1829-4c8a-9519-bcc42a7ee050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:37.099348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32cb8c-cee4-40d4-b1de-9bd803280142 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:37.111937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a8518-5455-4024-8c16-fea3362465ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:37.113837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a8518-5455-4024-8c16-fea3362465ce admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:37.115071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a8518-5455-4024-8c16-fea3362465ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:37.115362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a8518-5455-4024-8c16-fea3362465ce admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:37.116698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a8518-5455-4024-8c16-fea3362465ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:37.119536 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a8518-5455-4024-8c16-fea3362465ce admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:37.123047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:37.231446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 894/1814] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:36 2022] POST /identity/v3/users => generated 300 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:37.250055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a8518-5455-4024-8c16-fea3362465ce admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:37.323485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a8518-5455-4024-8c16-fea3362465ce admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:37.336123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739f386-0d18-40d8-994d-fc428ab73d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:37.336815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739f386-0d18-40d8-994d-fc428ab73d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:37.338896 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 921/1815] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:36 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:37.343505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739f386-0d18-40d8-994d-fc428ab73d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:37.343505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0739f386-0d18-40d8-994d-fc428ab73d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:37.343505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739f386-0d18-40d8-994d-fc428ab73d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:37.345160 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0739f386-0d18-40d8-994d-fc428ab73d10 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:37.382306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 895/1816] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:37.383976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4941f-1829-4c8a-9519-bcc42a7ee050 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:37.398171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4941f-1829-4c8a-9519-bcc42a7ee050 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:37.410989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5539b-a465-4da1-92e7-f8283a808ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:37.412770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5539b-a465-4da1-92e7-f8283a808ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:37.413257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5539b-a465-4da1-92e7-f8283a808ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:37.413755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5539b-a465-4da1-92e7-f8283a808ccc admin admin] PATH_INFO: `/v3/projects/1063282dbe9946739b401029bd5642b7/users/d31eb7356e9e4f039ac9ddd8b7fe836e/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:37.456778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5539b-a465-4da1-92e7-f8283a808ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1063282dbe9946739b401029bd5642b7, user_id=d31eb7356e9e4f039ac9ddd8b7fe836e, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:37.460007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739f386-0d18-40d8-994d-fc428ab73d10 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:37.460562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5539b-a465-4da1-92e7-f8283a808ccc admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:37.463520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0739f386-0d18-40d8-994d-fc428ab73d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:37.504312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 922/1817] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:37 2022] PUT /identity/v3/projects/1063282dbe9946739b401029bd5642b7/users/d31eb7356e9e4f039ac9ddd8b7fe836e/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:37.508724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5539b-a465-4da1-92e7-f8283a808ccc admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:37.611003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0739f386-0d18-40d8-994d-fc428ab73d10 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:37.776657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5539b-a465-4da1-92e7-f8283a808ccc admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:37.803107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8937da8c-6ab0-47ef-882f-eb8d5d64a887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:37.806415 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937da8c-6ab0-47ef-882f-eb8d5d64a887 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:37.806760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937da8c-6ab0-47ef-882f-eb8d5d64a887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:37.809365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8937da8c-6ab0-47ef-882f-eb8d5d64a887 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:37.810034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937da8c-6ab0-47ef-882f-eb8d5d64a887 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:37.816851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8937da8c-6ab0-47ef-882f-eb8d5d64a887 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:37.870671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 923/1818] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:37.885001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9dea4-5966-4080-ac10-fdf3fd0f9bcb None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:37.885454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9dea4-5966-4080-ac10-fdf3fd0f9bcb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:37.885784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9dea4-5966-4080-ac10-fdf3fd0f9bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:37.895492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9802580-6316-483a-9d1b-6c76859204e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:37.901361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9802580-6316-483a-9d1b-6c76859204e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:37.902035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9802580-6316-483a-9d1b-6c76859204e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:37.902467 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9802580-6316-483a-9d1b-6c76859204e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:37.964565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ced9dea4-5966-4080-ac10-fdf3fd0f9bcb None None] MFA Rules not processed for user `b3b2d5dee6d240558a71331e05035a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:37.973058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ced9dea4-5966-4080-ac10-fdf3fd0f9bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.125771 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 924/1819] 10.222.0.49 () {58 vars in 1015 bytes} [Thu Jul 21 04:18:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:38.141606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9dea4-5966-4080-ac10-fdf3fd0f9bcb None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:38.176404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9dea4-5966-4080-ac10-fdf3fd0f9bcb None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:38.186188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8baefd-20e7-40d6-afc8-ec1c3457e362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:38.189295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8baefd-20e7-40d6-afc8-ec1c3457e362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.189629 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8baefd-20e7-40d6-afc8-ec1c3457e362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.189924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8baefd-20e7-40d6-afc8-ec1c3457e362 admin admin] PATH_INFO: `/v3/projects/1063282dbe9946739b401029bd5642b7/users/d31eb7356e9e4f039ac9ddd8b7fe836e/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.193896 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8baefd-20e7-40d6-afc8-ec1c3457e362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1063282dbe9946739b401029bd5642b7, user_id=d31eb7356e9e4f039ac9ddd8b7fe836e, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:38.196442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9802580-6316-483a-9d1b-6c76859204e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:38.196762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8baefd-20e7-40d6-afc8-ec1c3457e362 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:38.199535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9802580-6316-483a-9d1b-6c76859204e6 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:38.218877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 925/1820] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:38 2022] PUT /identity/v3/projects/1063282dbe9946739b401029bd5642b7/users/d31eb7356e9e4f039ac9ddd8b7fe836e/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:38.219792 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8baefd-20e7-40d6-afc8-ec1c3457e362 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:38.228823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-af8baefd-20e7-40d6-afc8-ec1c3457e362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.251690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 896/1821] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:37 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 792 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:38.253337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9802580-6316-483a-9d1b-6c76859204e6 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:38.273648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a9802580-6316-483a-9d1b-6c76859204e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.308607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:38.336520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9802580-6316-483a-9d1b-6c76859204e6 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:38.431458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:38.521397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8baefd-20e7-40d6-afc8-ec1c3457e362 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:38.541682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:38.545605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23b8ac-1d90-4a91-b4bf-81da599c6977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:38.546327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.546437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23b8ac-1d90-4a91-b4bf-81da599c6977 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.546653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23b8ac-1d90-4a91-b4bf-81da599c6977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.547728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23b8ac-1d90-4a91-b4bf-81da599c6977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.549168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.550755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] PATH_INFO: `/v3/users/be9eb26541c543dc9fde9012ef4148bd` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.557194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9eb26541c543dc9fde9012ef4148bd)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:38.564704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:38.566524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23b8ac-1d90-4a91-b4bf-81da599c6977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:38.568546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e23b8ac-1d90-4a91-b4bf-81da599c6977 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:38.597015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 897/1822] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:38.598150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23b8ac-1d90-4a91-b4bf-81da599c6977 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:38.600708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5e23b8ac-1d90-4a91-b4bf-81da599c6977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.656682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23b8ac-1d90-4a91-b4bf-81da599c6977 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:38.666443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c12a55-2ffd-44b1-ba64-7a0ae272c665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:38.673369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c12a55-2ffd-44b1-ba64-7a0ae272c665 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.673369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c12a55-2ffd-44b1-ba64-7a0ae272c665 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.673369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c12a55-2ffd-44b1-ba64-7a0ae272c665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.687720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c12a55-2ffd-44b1-ba64-7a0ae272c665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:38.695955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c12a55-2ffd-44b1-ba64-7a0ae272c665 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:38.729808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 898/1823] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:38.734286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4a60-2c98-4f71-8363-03b546b947cf None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:38.734579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4a60-2c98-4f71-8363-03b546b947cf None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:38.739066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4a60-2c98-4f71-8363-03b546b947cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:38.740557 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9eb26541c543dc9fde9012ef4148bd'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:38.742492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9eb26541c543dc9fde9012ef4148bd'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:38.745278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9eb26541c543dc9fde9012ef4148bd'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:38.768495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9eb26541c543dc9fde9012ef4148bd'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:38.801051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9eb26541c543dc9fde9012ef4148bd'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:38.815630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-33fc4a60-2c98-4f71-8363-03b546b947cf None None] MFA Rules not processed for user `d31eb7356e9e4f039ac9ddd8b7fe836e`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:38.820439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-33fc4a60-2c98-4f71-8363-03b546b947cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:38.871793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 926/1824] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:38 2022] DELETE /identity/v3/users/be9eb26541c543dc9fde9012ef4148bd => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:38.874985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:38.881587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:39.041658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 899/1825] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:39.041658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4a60-2c98-4f71-8363-03b546b947cf None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:39.042282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-33fc4a60-2c98-4f71-8363-03b546b947cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:39.063006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4146f41-5e9a-4dfd-86db-4e265d5f3dbd admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.075824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8db56c-c57d-4d43-9ad2-852cc847db6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:39.076504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db56c-c57d-4d43-9ad2-852cc847db6a service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.076786 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db56c-c57d-4d43-9ad2-852cc847db6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.077061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8db56c-c57d-4d43-9ad2-852cc847db6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.084078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0f8db56c-c57d-4d43-9ad2-852cc847db6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:39.118687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8db56c-c57d-4d43-9ad2-852cc847db6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:39.120221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8db56c-c57d-4d43-9ad2-852cc847db6a service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:39.140877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 927/1826] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:39.144157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a174a5a-a06c-4ee9-9f2b-91a824b65205 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.144400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a174a5a-a06c-4ee9-9f2b-91a824b65205 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.144684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a174a5a-a06c-4ee9-9f2b-91a824b65205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.195735 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-4a174a5a-a06c-4ee9-9f2b-91a824b65205 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:39.196978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4a174a5a-a06c-4ee9-9f2b-91a824b65205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:39.240349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4a60-2c98-4f71-8363-03b546b947cf None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.329635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:39.364313 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:39.386732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7a8e6-f256-41c8-a4d8-76bef17d836c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:39.387723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a8e6-f256-41c8-a4d8-76bef17d836c service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.388182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a8e6-f256-41c8-a4d8-76bef17d836c service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.388654 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7a8e6-f256-41c8-a4d8-76bef17d836c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.390680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-57c7a8e6-f256-41c8-a4d8-76bef17d836c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:39.395373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 928/1827] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:39.400405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a174a5a-a06c-4ee9-9f2b-91a824b65205 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:39.404105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4a174a5a-a06c-4ee9-9f2b-91a824b65205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:39.442482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a174a5a-a06c-4ee9-9f2b-91a824b65205 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.447704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95974758-943c-4f5a-ba55-b4d300393e9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:39.448374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95974758-943c-4f5a-ba55-b4d300393e9b service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.466626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95974758-943c-4f5a-ba55-b4d300393e9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.466938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95974758-943c-4f5a-ba55-b4d300393e9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.560306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a8e6-f256-41c8-a4d8-76bef17d836c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:39.562066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7a8e6-f256-41c8-a4d8-76bef17d836c service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:39.582010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 900/1828] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:39 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:39.582784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7a8e6-f256-41c8-a4d8-76bef17d836c service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:39.593458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-57c7a8e6-f256-41c8-a4d8-76bef17d836c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:39.614591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95974758-943c-4f5a-ba55-b4d300393e9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:39.619216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95974758-943c-4f5a-ba55-b4d300393e9b service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:39.620875 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7a8e6-f256-41c8-a4d8-76bef17d836c service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:39.628215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af39284-4597-4d1f-8fa5-2b01c523c9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:39.629074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af39284-4597-4d1f-8fa5-2b01c523c9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:39.629362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af39284-4597-4d1f-8fa5-2b01c523c9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:39.629642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af39284-4597-4d1f-8fa5-2b01c523c9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:39.640994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 929/1829] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:39.658913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af39284-4597-4d1f-8fa5-2b01c523c9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:39.662946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af39284-4597-4d1f-8fa5-2b01c523c9e2 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:39.693559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 901/1830] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:40.205184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95974758-943c-4f5a-ba55-b4d300393e9b service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:40.207532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-95974758-943c-4f5a-ba55-b4d300393e9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:40.234476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95974758-943c-4f5a-ba55-b4d300393e9b service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:40.249623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:40.254640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:40.254971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:40.256777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] PATH_INFO: `/v3/users/b822a810377b4cb08ec617a0930acf6f` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:40.260199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b822a810377b4cb08ec617a0930acf6f)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:40.269104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:40.383856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b822a810377b4cb08ec617a0930acf6f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:40.384576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b822a810377b4cb08ec617a0930acf6f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:40.385187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b822a810377b4cb08ec617a0930acf6f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:40.400538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b822a810377b4cb08ec617a0930acf6f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:40.420937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b822a810377b4cb08ec617a0930acf6f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:40.482053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 930/1831] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:40 2022] DELETE /identity/v3/users/b822a810377b4cb08ec617a0930acf6f => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:40.485282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c66476-9661-456d-85f3-e28a0d6a60db None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:40.485589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c66476-9661-456d-85f3-e28a0d6a60db None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:40.485913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c66476-9661-456d-85f3-e28a0d6a60db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:40.549177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-74c66476-9661-456d-85f3-e28a0d6a60db None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:40.550769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-74c66476-9661-456d-85f3-e28a0d6a60db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:40.658048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 902/1832] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:40.741876 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:40.744557 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:40.939483 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1de27e7-5cf9-4a0e-8f59-dfb757e0089b admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:40.947861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e15b6-1c0b-4dad-ace9-079374594eae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:40.950410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e15b6-1c0b-4dad-ace9-079374594eae service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:40.952545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e15b6-1c0b-4dad-ace9-079374594eae service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:40.954217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e15b6-1c0b-4dad-ace9-079374594eae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:40.997833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e15b6-1c0b-4dad-ace9-079374594eae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:41.009288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e15b6-1c0b-4dad-ace9-079374594eae service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:41.041641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31aa43-800c-457c-8c14-ae694fcf8499 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:41.042213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31aa43-800c-457c-8c14-ae694fcf8499 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:41.042310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31aa43-800c-457c-8c14-ae694fcf8499 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:41.044957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 903/1833] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:18:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 21 04:18:41.068089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 931/1834] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:41.583511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7a3aa-2976-48ce-974d-d5d77913825e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:41.583951 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7a3aa-2976-48ce-974d-d5d77913825e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:41.584150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7a3aa-2976-48ce-974d-d5d77913825e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:41.644967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-49c7a3aa-2976-48ce-974d-d5d77913825e None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:41.647221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-49c7a3aa-2976-48ce-974d-d5d77913825e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:41.901290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 904/1835] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:18:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:42.504019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e15b6-1c0b-4dad-ace9-079374594eae service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:42.505563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-497e15b6-1c0b-4dad-ace9-079374594eae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:42.548391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e15b6-1c0b-4dad-ace9-079374594eae service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:42.577127 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524524c-9a7f-4d27-ac25-2dbb3397e889 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:42.577804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524524c-9a7f-4d27-ac25-2dbb3397e889 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:42.578100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524524c-9a7f-4d27-ac25-2dbb3397e889 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:42.578373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524524c-9a7f-4d27-ac25-2dbb3397e889 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:42.595368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:42.603877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524524c-9a7f-4d27-ac25-2dbb3397e889 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:42.605933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524524c-9a7f-4d27-ac25-2dbb3397e889 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:42.629291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 932/1836] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:43.155409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e3631-58bb-48a7-8572-41828e81c40c None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:43.156801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e3631-58bb-48a7-8572-41828e81c40c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:43.157928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278e3631-58bb-48a7-8572-41828e81c40c None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:43.163516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 905/1837] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:18:43 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:43.307958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524524c-9a7f-4d27-ac25-2dbb3397e889 service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:43.309983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9524524c-9a7f-4d27-ac25-2dbb3397e889 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:43.349153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524524c-9a7f-4d27-ac25-2dbb3397e889 service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:43.356456 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512d0d8-f99a-4abc-b79a-0129670b325d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:43.357000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512d0d8-f99a-4abc-b79a-0129670b325d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:43.357324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9512d0d8-f99a-4abc-b79a-0129670b325d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:43.366006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:43.380797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:43.384922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:43.385345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] PATH_INFO: `/v3/projects/d2d4d9b2a7584877994a6bc511394c9b` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:43.387653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:43.389395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2d4d9b2a7584877994a6bc511394c9b)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:43.391738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:43.410143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-9512d0d8-f99a-4abc-b79a-0129670b325d None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:43.416614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9512d0d8-f99a-4abc-b79a-0129670b325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:43.441786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 906/1838] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:18:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:43.574508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2d4d9b2a7584877994a6bc511394c9b', 'request_id': 'req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:43.585377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512d0d8-f99a-4abc-b79a-0129670b325d None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:43.589550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9512d0d8-f99a-4abc-b79a-0129670b325d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:43.620498 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2d4d9b2a7584877994a6bc511394c9b', 'request_id': 'req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:43.640029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9512d0d8-f99a-4abc-b79a-0129670b325d None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:43.653160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2d4d9b2a7584877994a6bc511394c9b', 'request_id': 'req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:43.696143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] The token cache is being invalidate because project d2d4d9b2a7584877994a6bc511394c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:43.697679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:43.699785 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:43.703919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 933/1839] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:43 2022] DELETE /identity/v3/projects/d2d4d9b2a7584877994a6bc511394c9b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:43.712526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:43.714921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:43.889332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:43.891798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:43.892281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:43.896252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] PATH_INFO: `/v3/users/2b6efe1a4da84d43addca3ca393cf594` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:43.898494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b6efe1a4da84d43addca3ca393cf594)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:43.902302 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:43.928652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33d1e0-b2dc-4137-a0a8-09a33fbecb26 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:43.937579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:43.941642 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:43.942518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:43.943097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] PATH_INFO: `/v3/users/3353385d14cc410aa02cc501965f06bb` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:43.945054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3353385d14cc410aa02cc501965f06bb)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:43.949173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:44.037002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b6efe1a4da84d43addca3ca393cf594'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.039118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b6efe1a4da84d43addca3ca393cf594'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.039816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b6efe1a4da84d43addca3ca393cf594'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.069837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b6efe1a4da84d43addca3ca393cf594'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.079344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3353385d14cc410aa02cc501965f06bb'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.080972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3353385d14cc410aa02cc501965f06bb'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.081807 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b6efe1a4da84d43addca3ca393cf594'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.091637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3353385d14cc410aa02cc501965f06bb'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.108795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3353385d14cc410aa02cc501965f06bb'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.135817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-4f731caf-450f-4a60-aff6-e0994f65cc4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3353385d14cc410aa02cc501965f06bb'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:44.165602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 907/1840] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:43 2022] DELETE /identity/v3/users/2b6efe1a4da84d43addca3ca393cf594 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:44.171123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:44.175194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:44.178224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:44.197928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 934/1841] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:43 2022] DELETE /identity/v3/users/3353385d14cc410aa02cc501965f06bb => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:44.199680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e71157-e456-4dfb-baa9-3a9f7ef04b1b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:44.200178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e71157-e456-4dfb-baa9-3a9f7ef04b1b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:44.200603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e71157-e456-4dfb-baa9-3a9f7ef04b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:44.234729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-86e71157-e456-4dfb-baa9-3a9f7ef04b1b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:44.236858 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-86e71157-e456-4dfb-baa9-3a9f7ef04b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:44.368138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 935/1842] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:44.407482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e71157-e456-4dfb-baa9-3a9f7ef04b1b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:44.412991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-86e71157-e456-4dfb-baa9-3a9f7ef04b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:44.416265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2789aa70-2682-4895-9f78-b996118a6ba6 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:44.449727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:44.591712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e4bc-5417-426d-9b1f-44a784a66535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:44.592460 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e4bc-5417-426d-9b1f-44a784a66535 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:44.592766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e4bc-5417-426d-9b1f-44a784a66535 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:44.593028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a21e4bc-5417-426d-9b1f-44a784a66535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:44.597956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9a21e4bc-5417-426d-9b1f-44a784a66535 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:44.626749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21e4bc-5417-426d-9b1f-44a784a66535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:44.629467 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a21e4bc-5417-426d-9b1f-44a784a66535 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:44.657356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 908/1843] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:44.670468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e71157-e456-4dfb-baa9-3a9f7ef04b1b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:44.677901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdfd64-ff6e-4d49-80d6-4bcd7908bb7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:44.678916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdfd64-ff6e-4d49-80d6-4bcd7908bb7d service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:44.679185 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdfd64-ff6e-4d49-80d6-4bcd7908bb7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:44.679569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cdfd64-ff6e-4d49-80d6-4bcd7908bb7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:44.748499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdfd64-ff6e-4d49-80d6-4bcd7908bb7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:44.749912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cdfd64-ff6e-4d49-80d6-4bcd7908bb7d service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:44.810583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 936/1844] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:45.672490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e4bc-5417-426d-9b1f-44a784a66535 service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:45.678504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9a21e4bc-5417-426d-9b1f-44a784a66535 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:45.718066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a21e4bc-5417-426d-9b1f-44a784a66535 service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:45.735681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:45.740065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:45.740228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:45.740395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] PATH_INFO: `/v3/projects/fcece772f63c4346a275e4be77ac7642` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:45.746056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcece772f63c4346a275e4be77ac7642)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:45.754617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:45.919541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcece772f63c4346a275e4be77ac7642', 'request_id': 'req-5929295a-c060-4541-828d-1c77aa35b2a0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:45.943730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcece772f63c4346a275e4be77ac7642', 'request_id': 'req-5929295a-c060-4541-828d-1c77aa35b2a0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:45.954771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcece772f63c4346a275e4be77ac7642', 'request_id': 'req-5929295a-c060-4541-828d-1c77aa35b2a0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:45.972229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] The token cache is being invalidate because project fcece772f63c4346a275e4be77ac7642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:45.972771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:45.973883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:45.977514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 909/1845] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:45 2022] DELETE /identity/v3/projects/fcece772f63c4346a275e4be77ac7642 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:45.981418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdfd64-ff6e-4d49-80d6-4bcd7908bb7d service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:45.997149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cdfd64-ff6e-4d49-80d6-4bcd7908bb7d service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.184435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.185993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.186609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.187182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] PATH_INFO: `/v3/users/d31eb7356e9e4f039ac9ddd8b7fe836e` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.191622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31eb7356e9e4f039ac9ddd8b7fe836e)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.195810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.297249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:46.306087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31eb7356e9e4f039ac9ddd8b7fe836e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.308001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31eb7356e9e4f039ac9ddd8b7fe836e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.309406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31eb7356e9e4f039ac9ddd8b7fe836e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.330825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31eb7356e9e4f039ac9ddd8b7fe836e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.344802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31eb7356e9e4f039ac9ddd8b7fe836e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.380728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 937/1846] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:45 2022] DELETE /identity/v3/users/d31eb7356e9e4f039ac9ddd8b7fe836e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:46.569944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.571744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.609059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929295a-c060-4541-828d-1c77aa35b2a0 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.765192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.767519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.791954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.792943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.793120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.793412 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] PATH_INFO: `/v3/projects/e5d2e5c69a7c4762a7ccd7e8096baf81` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.797121 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5d2e5c69a7c4762a7ccd7e8096baf81)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.799784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:46.862614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:46.889621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc84ee3b-71f3-4ebd-85a9-96026bb98a97 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:46.910919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5d2e5c69a7c4762a7ccd7e8096baf81', 'request_id': 'req-1122ba38-c373-4ab0-b42a-a060473172e0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.920805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5d2e5c69a7c4762a7ccd7e8096baf81', 'request_id': 'req-1122ba38-c373-4ab0-b42a-a060473172e0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.928979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5d2e5c69a7c4762a7ccd7e8096baf81', 'request_id': 'req-1122ba38-c373-4ab0-b42a-a060473172e0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.954643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] The token cache is being invalidate because project e5d2e5c69a7c4762a7ccd7e8096baf81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:46.955170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.955929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:46.957651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 910/1847] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:46 2022] DELETE /identity/v3/projects/e5d2e5c69a7c4762a7ccd7e8096baf81 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:46.961714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:46.963909 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:46.972192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:46.973665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:46.973960 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:46.974243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] PATH_INFO: `/v3/projects/0cb0e9dbe34e4de9a3c8a6b1c94002ec` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:46.975749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cb0e9dbe34e4de9a3c8a6b1c94002ec)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:46.978578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.045710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb0e9dbe34e4de9a3c8a6b1c94002ec', 'request_id': 'req-54d035c2-0b22-41e9-add3-4eccbdb102cd'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.059867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb0e9dbe34e4de9a3c8a6b1c94002ec', 'request_id': 'req-54d035c2-0b22-41e9-add3-4eccbdb102cd'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.070206 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb0e9dbe34e4de9a3c8a6b1c94002ec', 'request_id': 'req-54d035c2-0b22-41e9-add3-4eccbdb102cd'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.079073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1122ba38-c373-4ab0-b42a-a060473172e0 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.081342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:47.091162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] The token cache is being invalidate because project 0cb0e9dbe34e4de9a3c8a6b1c94002ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:47.091457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.092195 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.094080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 938/1848] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:46 2022] DELETE /identity/v3/projects/0cb0e9dbe34e4de9a3c8a6b1c94002ec => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:47.094931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.097454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.159706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.160742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.161360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.161640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] PATH_INFO: `/v3/users/d29ac00bb05d456d9c63ee02385f93a3` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.162931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d29ac00bb05d456d9c63ee02385f93a3)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.165127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.186269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d035c2-0b22-41e9-add3-4eccbdb102cd admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.193505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.194459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.194877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.195189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] PATH_INFO: `/v3/projects/1063282dbe9946739b401029bd5642b7` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.196508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1063282dbe9946739b401029bd5642b7)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.198450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.231394 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd29ac00bb05d456d9c63ee02385f93a3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.232230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd29ac00bb05d456d9c63ee02385f93a3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.232872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd29ac00bb05d456d9c63ee02385f93a3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.241990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd29ac00bb05d456d9c63ee02385f93a3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.252810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-aad5da58-0cea-4298-aefd-5f268b45951a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd29ac00bb05d456d9c63ee02385f93a3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.253019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1063282dbe9946739b401029bd5642b7', 'request_id': 'req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.256210 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:47.262831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1063282dbe9946739b401029bd5642b7', 'request_id': 'req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.271341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1063282dbe9946739b401029bd5642b7', 'request_id': 'req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.282813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 911/1849] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:46 2022] DELETE /identity/v3/users/d29ac00bb05d456d9c63ee02385f93a3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:47.282813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d44290-164c-40cb-9c3a-1fe3b67cef62 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.282813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d44290-164c-40cb-9c3a-1fe3b67cef62 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.282813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d44290-164c-40cb-9c3a-1fe3b67cef62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.288076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] The token cache is being invalidate because project 1063282dbe9946739b401029bd5642b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:47.288395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.289203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f7f3bcfb-b53b-46fd-96eb-2d7f5374442a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.290993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 939/1850] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:47 2022] DELETE /identity/v3/projects/1063282dbe9946739b401029bd5642b7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:47.296236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adc0e5-b679-45a5-9d93-f1875f253828 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.296468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adc0e5-b679-45a5-9d93-f1875f253828 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.297289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adc0e5-b679-45a5-9d93-f1875f253828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.324728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-06d44290-164c-40cb-9c3a-1fe3b67cef62 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:47.325974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-06d44290-164c-40cb-9c3a-1fe3b67cef62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.328692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d9adc0e5-b679-45a5-9d93-f1875f253828 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:47.329967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d9adc0e5-b679-45a5-9d93-f1875f253828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.415928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 940/1851] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:47.431772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4493fa8-70c3-460a-aa5e-8d8b65389aef None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.431772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4493fa8-70c3-460a-aa5e-8d8b65389aef None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.431772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4493fa8-70c3-460a-aa5e-8d8b65389aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.432939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 912/1852] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:47.435063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02198797-2767-40e5-bbc4-27b4df3ad8f6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.435643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02198797-2767-40e5-bbc4-27b4df3ad8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.436105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02198797-2767-40e5-bbc4-27b4df3ad8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.459810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a4493fa8-70c3-460a-aa5e-8d8b65389aef None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:47.462729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a4493fa8-70c3-460a-aa5e-8d8b65389aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.476489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 941/1853] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:47.480466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4493fa8-70c3-460a-aa5e-8d8b65389aef None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.487226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-02198797-2767-40e5-bbc4-27b4df3ad8f6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:47.488472 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-02198797-2767-40e5-bbc4-27b4df3ad8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.494097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4493fa8-70c3-460a-aa5e-8d8b65389aef None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.499490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ef5ae-0def-4bae-8bcf-64b9379c9e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.499490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ef5ae-0def-4bae-8bcf-64b9379c9e33 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.499490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ef5ae-0def-4bae-8bcf-64b9379c9e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.499791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ef5ae-0def-4bae-8bcf-64b9379c9e33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.500629 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ef5ae-0def-4bae-8bcf-64b9379c9e33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:47.505177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ef5ae-0def-4bae-8bcf-64b9379c9e33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.505177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ef5ae-0def-4bae-8bcf-64b9379c9e33 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.512958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 913/1854] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:47.515923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02198797-2767-40e5-bbc4-27b4df3ad8f6 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.522657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 942/1855] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:47.523888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ef5ae-0def-4bae-8bcf-64b9379c9e33 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.525772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02198797-2767-40e5-bbc4-27b4df3ad8f6 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.531268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81d4af-153a-4ae6-986b-20b42b70f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.531952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81d4af-153a-4ae6-986b-20b42b70f98c admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.532223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81d4af-153a-4ae6-986b-20b42b70f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.532492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c81d4af-153a-4ae6-986b-20b42b70f98c admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.533973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81d4af-153a-4ae6-986b-20b42b70f98c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:47.534306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81d4af-153a-4ae6-986b-20b42b70f98c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.535305 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ef5ae-0def-4bae-8bcf-64b9379c9e33 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.536041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c81d4af-153a-4ae6-986b-20b42b70f98c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.540512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca79236-e972-4548-801d-47cee50b22b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.541417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79236-e972-4548-801d-47cee50b22b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.541890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79236-e972-4548-801d-47cee50b22b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.542362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca79236-e972-4548-801d-47cee50b22b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.543389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca79236-e972-4548-801d-47cee50b22b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.545411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca79236-e972-4548-801d-47cee50b22b1 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.550845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 914/1856] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:18:47.551705 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:47.555314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81d4af-153a-4ae6-986b-20b42b70f98c admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.568525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c81d4af-153a-4ae6-986b-20b42b70f98c admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.573976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1678a-ece0-44ae-b763-fe9b13617956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.574638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1678a-ece0-44ae-b763-fe9b13617956 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.574945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1678a-ece0-44ae-b763-fe9b13617956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.575273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1678a-ece0-44ae-b763-fe9b13617956 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.576080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1678a-ece0-44ae-b763-fe9b13617956 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.578130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1678a-ece0-44ae-b763-fe9b13617956 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.587047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 943/1857] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/projects => generated 375 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:47.595159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca79236-e972-4548-801d-47cee50b22b1 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.620091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 915/1858] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:47.622151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1678a-ece0-44ae-b763-fe9b13617956 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.691970 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca79236-e972-4548-801d-47cee50b22b1 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.735462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1678a-ece0-44ae-b763-fe9b13617956 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.743644 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f8567-43e8-4527-bfe3-4d7fb4ff439e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.745232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f8567-43e8-4527-bfe3-4d7fb4ff439e admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.745610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f8567-43e8-4527-bfe3-4d7fb4ff439e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.745970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f8567-43e8-4527-bfe3-4d7fb4ff439e admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.746755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f8567-43e8-4527-bfe3-4d7fb4ff439e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.750194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f8567-43e8-4527-bfe3-4d7fb4ff439e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.776573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59502364-754d-44af-9816-d5f36cc78664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.777455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59502364-754d-44af-9816-d5f36cc78664 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.777738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59502364-754d-44af-9816-d5f36cc78664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.778141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59502364-754d-44af-9816-d5f36cc78664 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.779042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59502364-754d-44af-9816-d5f36cc78664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.781257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59502364-754d-44af-9816-d5f36cc78664 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.794540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 916/1859] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:47.795492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f8567-43e8-4527-bfe3-4d7fb4ff439e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.798748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ea8f8567-43e8-4527-bfe3-4d7fb4ff439e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.812734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 944/1860] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/users => generated 288 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:47.813131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f8567-43e8-4527-bfe3-4d7fb4ff439e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.813807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59502364-754d-44af-9816-d5f36cc78664 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.818859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.819755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.820036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.820311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] PATH_INFO: `/v3/projects/2990b83a0c2145939060a2ccef175b6e` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.821517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2990b83a0c2145939060a2ccef175b6e)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.823459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.824352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59502364-754d-44af-9816-d5f36cc78664 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.829213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff1489-07f1-47cc-a9f5-cd915958506d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.830861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff1489-07f1-47cc-a9f5-cd915958506d admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.830861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff1489-07f1-47cc-a9f5-cd915958506d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.831096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ff1489-07f1-47cc-a9f5-cd915958506d admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.831682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff1489-07f1-47cc-a9f5-cd915958506d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.833286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ff1489-07f1-47cc-a9f5-cd915958506d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.846916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 945/1861] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:47.846916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff1489-07f1-47cc-a9f5-cd915958506d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.855547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ff1489-07f1-47cc-a9f5-cd915958506d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.859348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:47.860522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347db10-4d6c-45db-9357-075b6441f57d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.861411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347db10-4d6c-45db-9357-075b6441f57d admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.861782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347db10-4d6c-45db-9357-075b6441f57d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.862107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347db10-4d6c-45db-9357-075b6441f57d admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.862948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347db10-4d6c-45db-9357-075b6441f57d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.864809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347db10-4d6c-45db-9357-075b6441f57d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.876235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 946/1862] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:47.877292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347db10-4d6c-45db-9357-075b6441f57d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.881009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2990b83a0c2145939060a2ccef175b6e', 'request_id': 'req-1d787b6e-0fbb-41e4-addd-9a4038794246'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.887353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347db10-4d6c-45db-9357-075b6441f57d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.889333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2990b83a0c2145939060a2ccef175b6e', 'request_id': 'req-1d787b6e-0fbb-41e4-addd-9a4038794246'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.895845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2990b83a0c2145939060a2ccef175b6e', 'request_id': 'req-1d787b6e-0fbb-41e4-addd-9a4038794246'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.910888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] The token cache is being invalidate because project 2990b83a0c2145939060a2ccef175b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:47.911232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.911906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:47.913891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 917/1863] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:47 2022] DELETE /identity/v3/projects/2990b83a0c2145939060a2ccef175b6e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:47.915277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:47.917007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.949314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1352f6-c5af-40c6-a863-bc0c93f27d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.950105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1352f6-c5af-40c6-a863-bc0c93f27d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.950386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1352f6-c5af-40c6-a863-bc0c93f27d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.950662 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1352f6-c5af-40c6-a863-bc0c93f27d10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.951422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1352f6-c5af-40c6-a863-bc0c93f27d10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.953147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1352f6-c5af-40c6-a863-bc0c93f27d10 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:47.956181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:47.967625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 947/1864] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:47.969403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b010d22-8eca-46b2-8998-f675a8525862 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.969742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b010d22-8eca-46b2-8998-f675a8525862 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.970022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b010d22-8eca-46b2-8998-f675a8525862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.988406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d787b6e-0fbb-41e4-addd-9a4038794246 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:47.989697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-9b010d22-8eca-46b2-8998-f675a8525862 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:47.990975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9b010d22-8eca-46b2-8998-f675a8525862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:47.993392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e723c7-2507-4872-9192-f10ae60d20a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:47.994119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e723c7-2507-4872-9192-f10ae60d20a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:47.994345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e723c7-2507-4872-9192-f10ae60d20a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:47.994616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e723c7-2507-4872-9192-f10ae60d20a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:47.995376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e723c7-2507-4872-9192-f10ae60d20a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:47.997138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e723c7-2507-4872-9192-f10ae60d20a3 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.002319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 948/1865] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:48.003064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b010d22-8eca-46b2-8998-f675a8525862 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.004716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9b010d22-8eca-46b2-8998-f675a8525862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.012400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 918/1866] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:48.014268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0cde7-1cad-437c-bb1f-9e7784c4a862 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.014569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0cde7-1cad-437c-bb1f-9e7784c4a862 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.014853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0cde7-1cad-437c-bb1f-9e7784c4a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.018522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b010d22-8eca-46b2-8998-f675a8525862 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.025223 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70918589-87a3-462b-9fbc-65e014471e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.026122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70918589-87a3-462b-9fbc-65e014471e8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.026439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70918589-87a3-462b-9fbc-65e014471e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.026719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70918589-87a3-462b-9fbc-65e014471e8b admin admin] PATH_INFO: `/v3/projects/cd46f4b4f0ec49eb924066837ad06437/users/ccce64ba4b1e48ec85b51a1a9fa3a86a/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.036314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-5cd0cde7-1cad-437c-bb1f-9e7784c4a862 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:48.037706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5cd0cde7-1cad-437c-bb1f-9e7784c4a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.045294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70918589-87a3-462b-9fbc-65e014471e8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd46f4b4f0ec49eb924066837ad06437, user_id=ccce64ba4b1e48ec85b51a1a9fa3a86a, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.047160 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 919/1867] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:48.048040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0cde7-1cad-437c-bb1f-9e7784c4a862 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.048163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70918589-87a3-462b-9fbc-65e014471e8b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.061003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0cde7-1cad-437c-bb1f-9e7784c4a862 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.066856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 949/1868] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:48 2022] PUT /identity/v3/projects/cd46f4b4f0ec49eb924066837ad06437/users/ccce64ba4b1e48ec85b51a1a9fa3a86a/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:48.068754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70918589-87a3-462b-9fbc-65e014471e8b admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.152704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70918589-87a3-462b-9fbc-65e014471e8b admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.159120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2705810a-accb-4c77-973a-65cf4c5a4376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.160698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705810a-accb-4c77-973a-65cf4c5a4376 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.161030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705810a-accb-4c77-973a-65cf4c5a4376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.161463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2705810a-accb-4c77-973a-65cf4c5a4376 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.162344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705810a-accb-4c77-973a-65cf4c5a4376 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:48.162660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705810a-accb-4c77-973a-65cf4c5a4376 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.164374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2705810a-accb-4c77-973a-65cf4c5a4376 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.178847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd06e36-1b3d-4e7f-af4b-015c4ba96dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.183080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd06e36-1b3d-4e7f-af4b-015c4ba96dc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.183080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd06e36-1b3d-4e7f-af4b-015c4ba96dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.183080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd06e36-1b3d-4e7f-af4b-015c4ba96dc8 admin admin] PATH_INFO: `/v3/projects/4b8d6918eda941f49d50461de979d062/users/c5c663a9d73840de8f9878a31a4d65f3/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.186491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 950/1869] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:48.192259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eed57-d8db-48f0-ad8a-fcb60d766949 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.192526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eed57-d8db-48f0-ad8a-fcb60d766949 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.192805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9eed57-d8db-48f0-ad8a-fcb60d766949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.221812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd06e36-1b3d-4e7f-af4b-015c4ba96dc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8d6918eda941f49d50461de979d062, user_id=c5c663a9d73840de8f9878a31a4d65f3, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.224701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2e9eed57-d8db-48f0-ad8a-fcb60d766949 None None] MFA Rules not processed for user `ccce64ba4b1e48ec85b51a1a9fa3a86a`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:48.225313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd06e36-1b3d-4e7f-af4b-015c4ba96dc8 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.226046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2e9eed57-d8db-48f0-ad8a-fcb60d766949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.248537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 920/1870] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:48 2022] PUT /identity/v3/projects/4b8d6918eda941f49d50461de979d062/users/c5c663a9d73840de8f9878a31a4d65f3/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:48.256059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd06e36-1b3d-4e7f-af4b-015c4ba96dc8 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.305004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:48.331838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 951/1871] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:48.333866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822cd53-581f-4e15-902e-19d374347e8c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.334168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822cd53-581f-4e15-902e-19d374347e8c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.334888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822cd53-581f-4e15-902e-19d374347e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.351132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd06e36-1b3d-4e7f-af4b-015c4ba96dc8 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.364007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68036e2-0413-4fd5-b43c-14039ec5eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.364863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68036e2-0413-4fd5-b43c-14039ec5eb43 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.365244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68036e2-0413-4fd5-b43c-14039ec5eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.367404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68036e2-0413-4fd5-b43c-14039ec5eb43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.368352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68036e2-0413-4fd5-b43c-14039ec5eb43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.370983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68036e2-0413-4fd5-b43c-14039ec5eb43 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.386309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-8822cd53-581f-4e15-902e-19d374347e8c None None] MFA Rules not processed for user `c5c663a9d73840de8f9878a31a4d65f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:48.387676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8822cd53-581f-4e15-902e-19d374347e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.400383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 921/1872] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:48 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:48.404281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68036e2-0413-4fd5-b43c-14039ec5eb43 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.446326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:48.481217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 952/1873] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:48.482208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822cd53-581f-4e15-902e-19d374347e8c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.493861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822cd53-581f-4e15-902e-19d374347e8c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.495219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68036e2-0413-4fd5-b43c-14039ec5eb43 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.500600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d76ad-ba1e-46c7-9338-b9cb723baba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.500767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e56865-0fd2-4a83-990f-c778c98a15cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.502986 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d76ad-ba1e-46c7-9338-b9cb723baba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.503120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e56865-0fd2-4a83-990f-c778c98a15cd admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.503227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d76ad-ba1e-46c7-9338-b9cb723baba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.503320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e56865-0fd2-4a83-990f-c778c98a15cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.503410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d76ad-ba1e-46c7-9338-b9cb723baba1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.503503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e56865-0fd2-4a83-990f-c778c98a15cd admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.503503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e56865-0fd2-4a83-990f-c778c98a15cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.503659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d76ad-ba1e-46c7-9338-b9cb723baba1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.506090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d76ad-ba1e-46c7-9338-b9cb723baba1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.506215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e56865-0fd2-4a83-990f-c778c98a15cd admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.541948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 953/1874] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:48 2022] POST /identity/v3/users => generated 289 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:48.544336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e56865-0fd2-4a83-990f-c778c98a15cd admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.548821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-41e56865-0fd2-4a83-990f-c778c98a15cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:48.582428 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 922/1875] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:48 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:48.585010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d76ad-ba1e-46c7-9338-b9cb723baba1 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.750623 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d76ad-ba1e-46c7-9338-b9cb723baba1 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.767038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b63f1-1a49-412f-a8a3-f7af837b32ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.768307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b63f1-1a49-412f-a8a3-f7af837b32ab admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.768598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b63f1-1a49-412f-a8a3-f7af837b32ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.768877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b63f1-1a49-412f-a8a3-f7af837b32ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.770304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b63f1-1a49-412f-a8a3-f7af837b32ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.772005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b63f1-1a49-412f-a8a3-f7af837b32ab admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.779198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e56865-0fd2-4a83-990f-c778c98a15cd admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.809008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 923/1876] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:48.811274 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b63f1-1a49-412f-a8a3-f7af837b32ab admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.835471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b63f1-1a49-412f-a8a3-f7af837b32ab admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.843307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427a392-15b0-47a1-ab08-1ca803dce2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.844524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427a392-15b0-47a1-ab08-1ca803dce2db admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.844524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427a392-15b0-47a1-ab08-1ca803dce2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.845064 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1427a392-15b0-47a1-ab08-1ca803dce2db admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.847264 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427a392-15b0-47a1-ab08-1ca803dce2db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.849629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1427a392-15b0-47a1-ab08-1ca803dce2db admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.883548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 924/1877] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:48 2022] POST /identity/v3/users => generated 298 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:48.886108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427a392-15b0-47a1-ab08-1ca803dce2db admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.897110 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05523ca-a00b-42d6-b3e6-0e925711a653 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210e10ee6b649399de11ac719a89718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.898905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05523ca-a00b-42d6-b3e6-0e925711a653 service glance] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.899966 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05523ca-a00b-42d6-b3e6-0e925711a653 service glance] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.900258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05523ca-a00b-42d6-b3e6-0e925711a653 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.902005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1427a392-15b0-47a1-ab08-1ca803dce2db admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.922190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a10348-b363-46c5-9cfb-01cccf4dd6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.922884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10348-b363-46c5-9cfb-01cccf4dd6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.925959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10348-b363-46c5-9cfb-01cccf4dd6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.925959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a10348-b363-46c5-9cfb-01cccf4dd6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.926156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a10348-b363-46c5-9cfb-01cccf4dd6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.932046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a10348-b363-46c5-9cfb-01cccf4dd6c4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:48.954808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 925/1878] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:48.956630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a10348-b363-46c5-9cfb-01cccf4dd6c4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:48.964396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:48.970776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a10348-b363-46c5-9cfb-01cccf4dd6c4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:48.980980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bb10b-5c5b-4f15-aad8-f36150dc7cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:48.982053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bb10b-5c5b-4f15-aad8-f36150dc7cad admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:48.982522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bb10b-5c5b-4f15-aad8-f36150dc7cad admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:48.982995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32bb10b-5c5b-4f15-aad8-f36150dc7cad admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:48.983925 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bb10b-5c5b-4f15-aad8-f36150dc7cad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:48.985817 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32bb10b-5c5b-4f15-aad8-f36150dc7cad admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.000144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05523ca-a00b-42d6-b3e6-0e925711a653 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.001648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05523ca-a00b-42d6-b3e6-0e925711a653 service glance] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.006168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 926/1879] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:49.007170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bb10b-5c5b-4f15-aad8-f36150dc7cad admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.023370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32bb10b-5c5b-4f15-aad8-f36150dc7cad admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.028944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ecc5ab-b8c2-44fb-b649-4de5d0b04731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.030203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc5ab-b8c2-44fb-b649-4de5d0b04731 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.030911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc5ab-b8c2-44fb-b649-4de5d0b04731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.031320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ecc5ab-b8c2-44fb-b649-4de5d0b04731 admin admin] PATH_INFO: `/v3/projects/b5ac29f974c9485c9434441d299af935/users/3bf43c3dfcdf43f8893dc14b06b273df/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.044248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 954/1880] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:49.047657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05523ca-a00b-42d6-b3e6-0e925711a653 service glance] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.070306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecc5ab-b8c2-44fb-b649-4de5d0b04731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5ac29f974c9485c9434441d299af935, user_id=3bf43c3dfcdf43f8893dc14b06b273df, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.074077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ecc5ab-b8c2-44fb-b649-4de5d0b04731 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.081090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05523ca-a00b-42d6-b3e6-0e925711a653 service glance] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.093165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad608df-9659-4e92-85fb-925876172787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.096861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad608df-9659-4e92-85fb-925876172787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.097160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad608df-9659-4e92-85fb-925876172787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.097452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad608df-9659-4e92-85fb-925876172787 admin admin] PATH_INFO: `/v3/projects/96e6795412ac4176be12b2fec26bfca0/users/bcb80e542f3e4e36ae6b7b6c2dd8471a/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.108630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 927/1881] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:49 2022] PUT /identity/v3/projects/b5ac29f974c9485c9434441d299af935/users/3bf43c3dfcdf43f8893dc14b06b273df/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:49.120889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07dfb-c317-49ed-9af9-a48a51a66f67 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.123082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07dfb-c317-49ed-9af9-a48a51a66f67 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.123816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc07dfb-c317-49ed-9af9-a48a51a66f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.127600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:49.133405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad608df-9659-4e92-85fb-925876172787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e6795412ac4176be12b2fec26bfca0, user_id=bcb80e542f3e4e36ae6b7b6c2dd8471a, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.137266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad608df-9659-4e92-85fb-925876172787 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.153809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 955/1882] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:49 2022] PUT /identity/v3/projects/96e6795412ac4176be12b2fec26bfca0/users/bcb80e542f3e4e36ae6b7b6c2dd8471a/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:49.163793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-fdc07dfb-c317-49ed-9af9-a48a51a66f67 None None] MFA Rules not processed for user `3bf43c3dfcdf43f8893dc14b06b273df`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:49.164120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad608df-9659-4e92-85fb-925876172787 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.165121 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fdc07dfb-c317-49ed-9af9-a48a51a66f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.261205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad608df-9659-4e92-85fb-925876172787 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.267331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d0122-6d4c-4349-90b4-0f63453aa850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.268667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d0122-6d4c-4349-90b4-0f63453aa850 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.269025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d0122-6d4c-4349-90b4-0f63453aa850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.269459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d0122-6d4c-4349-90b4-0f63453aa850 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.270477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d0122-6d4c-4349-90b4-0f63453aa850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.273292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d0122-6d4c-4349-90b4-0f63453aa850 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.284836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 928/1883] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:49.286294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc07dfb-c317-49ed-9af9-a48a51a66f67 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.288943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 956/1884] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:49.293746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d0122-6d4c-4349-90b4-0f63453aa850 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.305199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc07dfb-c317-49ed-9af9-a48a51a66f67 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.312321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3682b0e-d5f2-4a94-b8fa-1955bbcfe571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.313090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d0122-6d4c-4349-90b4-0f63453aa850 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.313422 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3682b0e-d5f2-4a94-b8fa-1955bbcfe571 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.313705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3682b0e-d5f2-4a94-b8fa-1955bbcfe571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.314519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3682b0e-d5f2-4a94-b8fa-1955bbcfe571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.315372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3682b0e-d5f2-4a94-b8fa-1955bbcfe571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.318078 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3682b0e-d5f2-4a94-b8fa-1955bbcfe571 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.320472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f720adf-7702-4223-8549-317ae60f936c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.323144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f720adf-7702-4223-8549-317ae60f936c admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.323619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f720adf-7702-4223-8549-317ae60f936c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.324507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f720adf-7702-4223-8549-317ae60f936c admin admin] PATH_INFO: `/v3/projects/96e6795412ac4176be12b2fec26bfca0/users/bcb80e542f3e4e36ae6b7b6c2dd8471a/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.326862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f720adf-7702-4223-8549-317ae60f936c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96e6795412ac4176be12b2fec26bfca0, user_id=bcb80e542f3e4e36ae6b7b6c2dd8471a, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.333096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f720adf-7702-4223-8549-317ae60f936c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.350103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 957/1885] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:49 2022] PUT /identity/v3/projects/96e6795412ac4176be12b2fec26bfca0/users/bcb80e542f3e4e36ae6b7b6c2dd8471a/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:49.353944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 929/1886] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/projects => generated 377 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:49.364077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3682b0e-d5f2-4a94-b8fa-1955bbcfe571 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.364908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960061b-929a-4dd1-9715-03634426aacd None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.365524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960061b-929a-4dd1-9715-03634426aacd None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.365994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2960061b-929a-4dd1-9715-03634426aacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.403028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2960061b-929a-4dd1-9715-03634426aacd None None] MFA Rules not processed for user `bcb80e542f3e4e36ae6b7b6c2dd8471a`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:49.404710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2960061b-929a-4dd1-9715-03634426aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.445769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3682b0e-d5f2-4a94-b8fa-1955bbcfe571 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.450886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997234bc-a015-420a-ab09-f8893111eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.451591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997234bc-a015-420a-ab09-f8893111eaf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.451882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997234bc-a015-420a-ab09-f8893111eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.452159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997234bc-a015-420a-ab09-f8893111eaf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.452854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997234bc-a015-420a-ab09-f8893111eaf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.454801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997234bc-a015-420a-ab09-f8893111eaf5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.485724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 930/1887] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:49.487595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997234bc-a015-420a-ab09-f8893111eaf5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.500470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 958/1888] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:49.501526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997234bc-a015-420a-ab09-f8893111eaf5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.507765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaecb0-f85e-430c-bdfa-77216dce00c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.508449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaecb0-f85e-430c-bdfa-77216dce00c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.508739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaecb0-f85e-430c-bdfa-77216dce00c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.509025 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdaecb0-f85e-430c-bdfa-77216dce00c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.509782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdaecb0-f85e-430c-bdfa-77216dce00c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.511569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdaecb0-f85e-430c-bdfa-77216dce00c5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.514537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960061b-929a-4dd1-9715-03634426aacd None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.515979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2960061b-929a-4dd1-9715-03634426aacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.525327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 931/1889] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:49.529366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaecb0-f85e-430c-bdfa-77216dce00c5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.541405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdaecb0-f85e-430c-bdfa-77216dce00c5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.549976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4aff3-6e9c-41f8-945e-251c09a2a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.550755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4aff3-6e9c-41f8-945e-251c09a2a8e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.551351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4aff3-6e9c-41f8-945e-251c09a2a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.551640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c4aff3-6e9c-41f8-945e-251c09a2a8e6 admin admin] PATH_INFO: `/v3/projects/9354703026ee4954b7a38cbb981b361f/users/789c2aafed144716b0b84ffa370fb05b/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.569549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:49.573165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4aff3-6e9c-41f8-945e-251c09a2a8e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9354703026ee4954b7a38cbb981b361f, user_id=789c2aafed144716b0b84ffa370fb05b, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.576949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c4aff3-6e9c-41f8-945e-251c09a2a8e6 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.580682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2960061b-929a-4dd1-9715-03634426aacd None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.588688 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01690-83a2-4f04-8201-aeac2f4f36d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.589438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01690-83a2-4f04-8201-aeac2f4f36d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.589784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01690-83a2-4f04-8201-aeac2f4f36d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.590141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d01690-83a2-4f04-8201-aeac2f4f36d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.599847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 932/1890] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:49 2022] PUT /identity/v3/projects/9354703026ee4954b7a38cbb981b361f/users/789c2aafed144716b0b84ffa370fb05b/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:49.603890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4aff3-6e9c-41f8-945e-251c09a2a8e6 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.608572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d01690-83a2-4f04-8201-aeac2f4f36d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.610261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d01690-83a2-4f04-8201-aeac2f4f36d0 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.617808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:49.624737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 959/1891] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:49.685574 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c4aff3-6e9c-41f8-945e-251c09a2a8e6 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.698734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2791e-9b52-467d-931f-131131065d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.700000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2791e-9b52-467d-931f-131131065d16 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.700725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2791e-9b52-467d-931f-131131065d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.701283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf2791e-9b52-467d-931f-131131065d16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.702713 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2791e-9b52-467d-931f-131131065d16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.707257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf2791e-9b52-467d-931f-131131065d16 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.725086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 933/1892] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:49.726369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01690-83a2-4f04-8201-aeac2f4f36d0 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.730108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2791e-9b52-467d-931f-131131065d16 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:49.737826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d01690-83a2-4f04-8201-aeac2f4f36d0 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.742449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d076d-1751-4c90-aed1-04ce2bb48ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.743362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d076d-1751-4c90-aed1-04ce2bb48ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.743655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d076d-1751-4c90-aed1-04ce2bb48ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.743940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d076d-1751-4c90-aed1-04ce2bb48ade admin admin] PATH_INFO: `/v3/projects/9354703026ee4954b7a38cbb981b361f/users/789c2aafed144716b0b84ffa370fb05b/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.745965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d076d-1751-4c90-aed1-04ce2bb48ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=9354703026ee4954b7a38cbb981b361f, user_id=789c2aafed144716b0b84ffa370fb05b, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.748666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99d076d-1751-4c90-aed1-04ce2bb48ade admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.759999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 960/1893] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:49 2022] PUT /identity/v3/projects/9354703026ee4954b7a38cbb981b361f/users/789c2aafed144716b0b84ffa370fb05b/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:49.770834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6855-4184-4463-a972-178064b68884 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.771158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6855-4184-4463-a972-178064b68884 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.771422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6855-4184-4463-a972-178064b68884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.789050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf2791e-9b52-467d-931f-131131065d16 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:49.800799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-298d6855-4184-4463-a972-178064b68884 None None] MFA Rules not processed for user `789c2aafed144716b0b84ffa370fb05b`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:49.802594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-298d6855-4184-4463-a972-178064b68884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:49.851197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0235-14ee-4090-a596-9e60742be0b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:49.852535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0235-14ee-4090-a596-9e60742be0b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:49.852827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0235-14ee-4090-a596-9e60742be0b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:49.853105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d0235-14ee-4090-a596-9e60742be0b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:49.892403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 961/1894] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:49.949649 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d0235-14ee-4090-a596-9e60742be0b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:49.951188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d0235-14ee-4090-a596-9e60742be0b2 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:49.956092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:49.966811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 934/1895] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:49.996560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d6855-4184-4463-a972-178064b68884 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:50.009268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d6855-4184-4463-a972-178064b68884 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.012933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785b38c5-cbc6-4488-b0af-406fcbe6128b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:50.013590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b38c5-cbc6-4488-b0af-406fcbe6128b service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.013875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b38c5-cbc6-4488-b0af-406fcbe6128b service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.014161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785b38c5-cbc6-4488-b0af-406fcbe6128b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.092705 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b38c5-cbc6-4488-b0af-406fcbe6128b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:50.094308 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785b38c5-cbc6-4488-b0af-406fcbe6128b service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:50.115821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 962/1896] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:50.827957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0235-14ee-4090-a596-9e60742be0b2 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:50.896178 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d0235-14ee-4090-a596-9e60742be0b2 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:50.900757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:50.901637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.901912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.902190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] PATH_INFO: `/v3/users/ccce64ba4b1e48ec85b51a1a9fa3a86a` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:50.903409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccce64ba4b1e48ec85b51a1a9fa3a86a)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:50.905359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:50.953397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccce64ba4b1e48ec85b51a1a9fa3a86a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:50.954042 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccce64ba4b1e48ec85b51a1a9fa3a86a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:50.954640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccce64ba4b1e48ec85b51a1a9fa3a86a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:50.961561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccce64ba4b1e48ec85b51a1a9fa3a86a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:50.968763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccce64ba4b1e48ec85b51a1a9fa3a86a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:50.985988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 935/1897] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:50 2022] DELETE /identity/v3/users/ccce64ba4b1e48ec85b51a1a9fa3a86a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:50.991169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82871606-189b-422e-82d6-daf50d4ad77c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:50.991462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82871606-189b-422e-82d6-daf50d4ad77c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:50.991759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82871606-189b-422e-82d6-daf50d4ad77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.009550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-82871606-189b-422e-82d6-daf50d4ad77c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:51.010750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-82871606-189b-422e-82d6-daf50d4ad77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:51.069228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 963/1898] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:51.078935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:51.080592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:51.138352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425313ad-67ae-4371-bad6-87755e2e6748 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:51.141866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9e0f9-ee35-4978-a837-97d50753a51d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:51.142554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9e0f9-ee35-4978-a837-97d50753a51d service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:51.142835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9e0f9-ee35-4978-a837-97d50753a51d service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:51.143162 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9e0f9-ee35-4978-a837-97d50753a51d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.152018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9e0f9-ee35-4978-a837-97d50753a51d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:51.153457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9e0f9-ee35-4978-a837-97d50753a51d service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:51.162837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 936/1899] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:51.623652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82871606-189b-422e-82d6-daf50d4ad77c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:51.625036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-82871606-189b-422e-82d6-daf50d4ad77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:51.638078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82871606-189b-422e-82d6-daf50d4ad77c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:51.646109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:51.647158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:51.647444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:51.647721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] PATH_INFO: `/v3/projects/cd46f4b4f0ec49eb924066837ad06437` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:51.649131 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd46f4b4f0ec49eb924066837ad06437)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:51.651248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:51.658987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:51.754699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd46f4b4f0ec49eb924066837ad06437', 'request_id': 'req-7699cd0a-903a-4244-af07-56557b250a73'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:51.919067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd46f4b4f0ec49eb924066837ad06437', 'request_id': 'req-7699cd0a-903a-4244-af07-56557b250a73'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:51.937373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd46f4b4f0ec49eb924066837ad06437', 'request_id': 'req-7699cd0a-903a-4244-af07-56557b250a73'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:51.966374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] The token cache is being invalidate because project cd46f4b4f0ec49eb924066837ad06437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:51.967122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:51.968151 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:51.970364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 964/1900] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:51 2022] DELETE /identity/v3/projects/cd46f4b4f0ec49eb924066837ad06437 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:51.974269 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9e0f9-ee35-4978-a837-97d50753a51d service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:51.986135 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9e0f9-ee35-4978-a837-97d50753a51d service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.022370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:52.089102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.090285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.090575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.090858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] PATH_INFO: `/v3/users/bcb80e542f3e4e36ae6b7b6c2dd8471a` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.092258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcb80e542f3e4e36ae6b7b6c2dd8471a)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.094367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.167436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcb80e542f3e4e36ae6b7b6c2dd8471a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.168301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcb80e542f3e4e36ae6b7b6c2dd8471a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.169066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcb80e542f3e4e36ae6b7b6c2dd8471a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.179829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcb80e542f3e4e36ae6b7b6c2dd8471a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.195794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcb80e542f3e4e36ae6b7b6c2dd8471a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.219119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 937/1901] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:51 2022] DELETE /identity/v3/users/bcb80e542f3e4e36ae6b7b6c2dd8471a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:52.458400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.460010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:52.474458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699cd0a-903a-4244-af07-56557b250a73 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.507085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.508733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:52.542904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.543829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.544236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.544525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] PATH_INFO: `/v3/users/8edd97611843497eb8051646dc456b2f` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.545738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8edd97611843497eb8051646dc456b2f)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.547755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.597309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d24a8-dbf6-4aac-9c6f-2f757d768c1e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.598507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8edd97611843497eb8051646dc456b2f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.599202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8edd97611843497eb8051646dc456b2f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.599793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8edd97611843497eb8051646dc456b2f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.602198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.603100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.603385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.603692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] PATH_INFO: `/v3/projects/96e6795412ac4176be12b2fec26bfca0` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.604912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96e6795412ac4176be12b2fec26bfca0)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.606841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.606971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8edd97611843497eb8051646dc456b2f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.615233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5fc85288-30e8-4d0e-8ac2-a442deb7e883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8edd97611843497eb8051646dc456b2f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.638293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 965/1902] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:52 2022] DELETE /identity/v3/users/8edd97611843497eb8051646dc456b2f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:52.643807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f085-172a-4d7c-8473-7728391c98d7 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.643956 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f085-172a-4d7c-8473-7728391c98d7 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.644238 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15f085-172a-4d7c-8473-7728391c98d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.656897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:52.662130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-cc15f085-172a-4d7c-8473-7728391c98d7 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:52.663624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-cc15f085-172a-4d7c-8473-7728391c98d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:52.664703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96e6795412ac4176be12b2fec26bfca0', 'request_id': 'req-a8408f7a-8765-47fc-8adc-42021feb9194'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.674357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:52.676217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96e6795412ac4176be12b2fec26bfca0', 'request_id': 'req-a8408f7a-8765-47fc-8adc-42021feb9194'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.684083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96e6795412ac4176be12b2fec26bfca0', 'request_id': 'req-a8408f7a-8765-47fc-8adc-42021feb9194'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.696515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] The token cache is being invalidate because project 96e6795412ac4176be12b2fec26bfca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:52.696722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.699150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a8408f7a-8765-47fc-8adc-42021feb9194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:52.703056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 938/1903] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:52 2022] DELETE /identity/v3/projects/96e6795412ac4176be12b2fec26bfca0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:52.708373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4428871-682f-4d10-88fa-6c0fb8b4c4e2 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.708766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4428871-682f-4d10-88fa-6c0fb8b4c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.709221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4428871-682f-4d10-88fa-6c0fb8b4c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.730600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e4428871-682f-4d10-88fa-6c0fb8b4c4e2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:52.732022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e4428871-682f-4d10-88fa-6c0fb8b4c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:52.740182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 966/1904] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:52.742835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 939/1905] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:18:52.753978 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4428871-682f-4d10-88fa-6c0fb8b4c4e2 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.755846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e4428871-682f-4d10-88fa-6c0fb8b4c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:52.756462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8144-5d5d-4324-bf94-3b31b4ec5df9 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.757001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8144-5d5d-4324-bf94-3b31b4ec5df9 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.757518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafe8144-5d5d-4324-bf94-3b31b4ec5df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.782127 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-eafe8144-5d5d-4324-bf94-3b31b4ec5df9 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:52.783457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-eafe8144-5d5d-4324-bf94-3b31b4ec5df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:52.800258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 967/1906] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:52.801194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe8144-5d5d-4324-bf94-3b31b4ec5df9 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.811327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafe8144-5d5d-4324-bf94-3b31b4ec5df9 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.822420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28911e-e9bc-4d30-aeef-57a2b2a535b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.823264 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28911e-e9bc-4d30-aeef-57a2b2a535b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.823614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28911e-e9bc-4d30-aeef-57a2b2a535b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.824284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28911e-e9bc-4d30-aeef-57a2b2a535b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.825095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28911e-e9bc-4d30-aeef-57a2b2a535b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:52.825471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28911e-e9bc-4d30-aeef-57a2b2a535b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.827678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28911e-e9bc-4d30-aeef-57a2b2a535b5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.841821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 968/1907] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:52.846303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28911e-e9bc-4d30-aeef-57a2b2a535b5 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.850194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4428871-682f-4d10-88fa-6c0fb8b4c4e2 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.857244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6f956-1707-43c9-848f-f83156755e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.857730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28911e-e9bc-4d30-aeef-57a2b2a535b5 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:52.858208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6f956-1707-43c9-848f-f83156755e90 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.858711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6f956-1707-43c9-848f-f83156755e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.859110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6f956-1707-43c9-848f-f83156755e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.869570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6736b-68bf-4eb4-86c5-184780fb0f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:52.870619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6736b-68bf-4eb4-86c5-184780fb0f4b admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:52.870912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6736b-68bf-4eb4-86c5-184780fb0f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:52.871473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6736b-68bf-4eb4-86c5-184780fb0f4b admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:52.872381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6736b-68bf-4eb4-86c5-184780fb0f4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.874421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6736b-68bf-4eb4-86c5-184780fb0f4b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.875307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6f956-1707-43c9-848f-f83156755e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:52.877431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6f956-1707-43c9-848f-f83156755e90 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:52.890221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 940/1908] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:52.906990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 969/1909] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:52 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:52.909573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6f956-1707-43c9-848f-f83156755e90 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:52.930287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6f956-1707-43c9-848f-f83156755e90 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.007955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035d94-2544-4c2a-9186-3ae065ba4f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.008775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035d94-2544-4c2a-9186-3ae065ba4f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.009255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035d94-2544-4c2a-9186-3ae065ba4f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.009636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05035d94-2544-4c2a-9186-3ae065ba4f22 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.010326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05035d94-2544-4c2a-9186-3ae065ba4f22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.012511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05035d94-2544-4c2a-9186-3ae065ba4f22 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.038280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 941/1910] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:52 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:53.047310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6736b-68bf-4eb4-86c5-184780fb0f4b admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.058687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6736b-68bf-4eb4-86c5-184780fb0f4b admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.063735 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8e90-77c0-4718-a230-00de988c32f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.064457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8e90-77c0-4718-a230-00de988c32f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.064745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8e90-77c0-4718-a230-00de988c32f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.065022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d8e90-77c0-4718-a230-00de988c32f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.065769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8e90-77c0-4718-a230-00de988c32f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.067411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d8e90-77c0-4718-a230-00de988c32f6 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.081536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 970/1911] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:18:53.083461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035d94-2544-4c2a-9186-3ae065ba4f22 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.097750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05035d94-2544-4c2a-9186-3ae065ba4f22 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.108219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f52e-4ba1-4fd3-8f55-543eb2da93c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.108970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f52e-4ba1-4fd3-8f55-543eb2da93c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.109322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f52e-4ba1-4fd3-8f55-543eb2da93c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.109665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e8f52e-4ba1-4fd3-8f55-543eb2da93c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.110559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f52e-4ba1-4fd3-8f55-543eb2da93c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.112966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e8f52e-4ba1-4fd3-8f55-543eb2da93c5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.131752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 942/1912] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:53 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:53.136381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8e90-77c0-4718-a230-00de988c32f6 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.155371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d8e90-77c0-4718-a230-00de988c32f6 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.188316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff0e47-13cc-42da-9d12-64da2c13850b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.190332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff0e47-13cc-42da-9d12-64da2c13850b admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.190877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff0e47-13cc-42da-9d12-64da2c13850b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.191193 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff0e47-13cc-42da-9d12-64da2c13850b admin admin] PATH_INFO: `/v3/projects/c698637ed2c14482a38796df553afa1e/users/a6b08ca66c914c4d9aad187ec8a611a5/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.225742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff0e47-13cc-42da-9d12-64da2c13850b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c698637ed2c14482a38796df553afa1e, user_id=a6b08ca66c914c4d9aad187ec8a611a5, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.229398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff0e47-13cc-42da-9d12-64da2c13850b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.253348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 971/1913] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:53 2022] PUT /identity/v3/projects/c698637ed2c14482a38796df553afa1e/users/a6b08ca66c914c4d9aad187ec8a611a5/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:53.263825 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f52e-4ba1-4fd3-8f55-543eb2da93c5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.265856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc23843-b5bc-4467-afea-d104a55bd543 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.265991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f6e8f52e-4ba1-4fd3-8f55-543eb2da93c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.266539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc23843-b5bc-4467-afea-d104a55bd543 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.267531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc23843-b5bc-4467-afea-d104a55bd543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.316074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-7cc23843-b5bc-4467-afea-d104a55bd543 None None] MFA Rules not processed for user `a6b08ca66c914c4d9aad187ec8a611a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:53.318491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7cc23843-b5bc-4467-afea-d104a55bd543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.333040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:53.346411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e8f52e-4ba1-4fd3-8f55-543eb2da93c5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.387328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 972/1914] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:53.388185 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc23843-b5bc-4467-afea-d104a55bd543 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.389457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7cc23843-b5bc-4467-afea-d104a55bd543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.406593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2f41e-66e6-40c3-a87f-73c103065c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.407292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f41e-66e6-40c3-a87f-73c103065c5e service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.407574 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f41e-66e6-40c3-a87f-73c103065c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.407992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc2f41e-66e6-40c3-a87f-73c103065c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.409985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7fc2f41e-66e6-40c3-a87f-73c103065c5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.426161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:53.465972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc23843-b5bc-4467-afea-d104a55bd543 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.471202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.472178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.472457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.472736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] PATH_INFO: `/v3/projects/eca79e52900d4581b0ef33007ba4d17d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.473941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eca79e52900d4581b0ef33007ba4d17d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.475927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.480241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2f41e-66e6-40c3-a87f-73c103065c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.481727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc2f41e-66e6-40c3-a87f-73c103065c5e service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.493832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 943/1915] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:53.494910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2f41e-66e6-40c3-a87f-73c103065c5e service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.496308 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7fc2f41e-66e6-40c3-a87f-73c103065c5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:53.509337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc2f41e-66e6-40c3-a87f-73c103065c5e service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.513220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fdfb3-02ff-466b-995a-716102079092 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.513852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fdfb3-02ff-466b-995a-716102079092 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.514137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fdfb3-02ff-466b-995a-716102079092 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.514413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fdfb3-02ff-466b-995a-716102079092 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.523663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fdfb3-02ff-466b-995a-716102079092 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.525248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4fdfb3-02ff-466b-995a-716102079092 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.531221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eca79e52900d4581b0ef33007ba4d17d', 'request_id': 'req-9380fe74-7012-4ee1-8a90-addf3ea883a7'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:53.537264 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 944/1916] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:53.551782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eca79e52900d4581b0ef33007ba4d17d', 'request_id': 'req-9380fe74-7012-4ee1-8a90-addf3ea883a7'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:53.560527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eca79e52900d4581b0ef33007ba4d17d', 'request_id': 'req-9380fe74-7012-4ee1-8a90-addf3ea883a7'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:53.577190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] The token cache is being invalidate because project eca79e52900d4581b0ef33007ba4d17d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:53.581139 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:53.581139 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:53.581628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 973/1917] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:53 2022] DELETE /identity/v3/projects/eca79e52900d4581b0ef33007ba4d17d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:53.586191 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fdfb3-02ff-466b-995a-716102079092 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:53.602556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fdfb3-02ff-466b-995a-716102079092 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:53.671145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:53.672483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:53.672984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:53.674271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] PATH_INFO: `/v3/users/7582fbb3a93e44159d0bb41aac3a60de` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:53.676138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7582fbb3a93e44159d0bb41aac3a60de)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:53.678732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:53.752857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:53.764060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7582fbb3a93e44159d0bb41aac3a60de'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:53.764996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7582fbb3a93e44159d0bb41aac3a60de'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:53.765624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7582fbb3a93e44159d0bb41aac3a60de'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:53.778446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7582fbb3a93e44159d0bb41aac3a60de'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:53.796545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-76c69172-fac6-4321-8b96-076684ae6410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7582fbb3a93e44159d0bb41aac3a60de'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:53.825191 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 945/1918] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:53 2022] DELETE /identity/v3/users/7582fbb3a93e44159d0bb41aac3a60de => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:54.429372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:54.430868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:54.445226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9380fe74-7012-4ee1-8a90-addf3ea883a7 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:54.516574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:54.518527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.519647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.519976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] PATH_INFO: `/v3/projects/72e32fffa04745a99ec6808e5126cead` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.521512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e32fffa04745a99ec6808e5126cead)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:54.523876 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:54.587207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e32fffa04745a99ec6808e5126cead', 'request_id': 'req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:54.596340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e32fffa04745a99ec6808e5126cead', 'request_id': 'req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:54.599892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:54.606512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e32fffa04745a99ec6808e5126cead', 'request_id': 'req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:54.629115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] The token cache is being invalidate because project 72e32fffa04745a99ec6808e5126cead was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:54.629511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:54.630274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6cbf39b6-8c5a-4ac7-95ec-b28d49a673e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:54.635556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 974/1919] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:54 2022] DELETE /identity/v3/projects/72e32fffa04745a99ec6808e5126cead => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:54.638665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783142a-60fa-4569-8a2e-36df45097b47 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.639602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783142a-60fa-4569-8a2e-36df45097b47 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.640117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783142a-60fa-4569-8a2e-36df45097b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.665967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-6783142a-60fa-4569-8a2e-36df45097b47 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:54.667304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6783142a-60fa-4569-8a2e-36df45097b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:54.757689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 946/1920] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:54.765631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf902-96f5-4093-ac5f-a27b973877a3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.765923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf902-96f5-4093-ac5f-a27b973877a3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.766257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31acf902-96f5-4093-ac5f-a27b973877a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.791575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-31acf902-96f5-4093-ac5f-a27b973877a3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:54.792806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-31acf902-96f5-4093-ac5f-a27b973877a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:54.800711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 975/1921] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:54.805021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783142a-60fa-4569-8a2e-36df45097b47 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:54.815806 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783142a-60fa-4569-8a2e-36df45097b47 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:54.820875 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ccc6b-db6e-46c5-99e7-948530bce2cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:54.821533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ccc6b-db6e-46c5-99e7-948530bce2cc admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.821813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ccc6b-db6e-46c5-99e7-948530bce2cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.822085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28ccc6b-db6e-46c5-99e7-948530bce2cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.822811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ccc6b-db6e-46c5-99e7-948530bce2cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:18:54.823147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ccc6b-db6e-46c5-99e7-948530bce2cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:54.824935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28ccc6b-db6e-46c5-99e7-948530bce2cc admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:54.838260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 947/1922] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:18:54.843347 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf902-96f5-4093-ac5f-a27b973877a3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:54.854000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31acf902-96f5-4093-ac5f-a27b973877a3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:54.858763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbd49a-549f-44eb-ad07-d6fa58650095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:54.859554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbd49a-549f-44eb-ad07-d6fa58650095 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.859834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbd49a-549f-44eb-ad07-d6fa58650095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.860109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbd49a-549f-44eb-ad07-d6fa58650095 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.861694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbd49a-549f-44eb-ad07-d6fa58650095 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:54.863855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbd49a-549f-44eb-ad07-d6fa58650095 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:54.889524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 976/1923] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:54 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:54.893728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ccc6b-db6e-46c5-99e7-948530bce2cc admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:54.904005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28ccc6b-db6e-46c5-99e7-948530bce2cc admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:54.962406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931a9df-50e8-4d77-9ba9-ab0b02f4f16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:54.963105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a9df-50e8-4d77-9ba9-ab0b02f4f16c admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:54.963396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a9df-50e8-4d77-9ba9-ab0b02f4f16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:54.963677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5931a9df-50e8-4d77-9ba9-ab0b02f4f16c admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:54.964360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931a9df-50e8-4d77-9ba9-ab0b02f4f16c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:54.966302 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5931a9df-50e8-4d77-9ba9-ab0b02f4f16c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:54.987963 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 948/1924] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:54 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:18:54.992054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbd49a-549f-44eb-ad07-d6fa58650095 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.002608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbd49a-549f-44eb-ad07-d6fa58650095 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.007448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a087e-ca12-48e4-9149-a6e9961b17e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.008136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a087e-ca12-48e4-9149-a6e9961b17e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.008420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a087e-ca12-48e4-9149-a6e9961b17e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.008731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a087e-ca12-48e4-9149-a6e9961b17e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.009484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a087e-ca12-48e4-9149-a6e9961b17e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.011118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a087e-ca12-48e4-9149-a6e9961b17e0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.025042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 977/1925] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:55.028105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931a9df-50e8-4d77-9ba9-ab0b02f4f16c admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.039117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5931a9df-50e8-4d77-9ba9-ab0b02f4f16c admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.046047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071d1570-4381-426c-9c10-a2653494d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.051195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d1570-4381-426c-9c10-a2653494d159 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.051195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d1570-4381-426c-9c10-a2653494d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.051195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071d1570-4381-426c-9c10-a2653494d159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.051195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d1570-4381-426c-9c10-a2653494d159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.051683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071d1570-4381-426c-9c10-a2653494d159 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.068182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 949/1926] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:55.075865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a087e-ca12-48e4-9149-a6e9961b17e0 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.088085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a087e-ca12-48e4-9149-a6e9961b17e0 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.093672 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5a4c-5583-4012-b6e7-2a1e2b878c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.094577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5a4c-5583-4012-b6e7-2a1e2b878c0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.094856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5a4c-5583-4012-b6e7-2a1e2b878c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.095723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac5a4c-5583-4012-b6e7-2a1e2b878c0d admin admin] PATH_INFO: `/v3/projects/e17875523bd04c2cabeff784e5d069d1/users/870a73c24bcf4e53b00f6abf8f255c47/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.115714 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac5a4c-5583-4012-b6e7-2a1e2b878c0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17875523bd04c2cabeff784e5d069d1, user_id=870a73c24bcf4e53b00f6abf8f255c47, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.119290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac5a4c-5583-4012-b6e7-2a1e2b878c0d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.140366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 978/1927] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:55 2022] PUT /identity/v3/projects/e17875523bd04c2cabeff784e5d069d1/users/870a73c24bcf4e53b00f6abf8f255c47/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:55.150492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66c597-0d73-4d84-a002-dea08b812e0d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.150790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66c597-0d73-4d84-a002-dea08b812e0d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.151098 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66c597-0d73-4d84-a002-dea08b812e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.185918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1c66c597-0d73-4d84-a002-dea08b812e0d None None] MFA Rules not processed for user `870a73c24bcf4e53b00f6abf8f255c47`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:55.187853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1c66c597-0d73-4d84-a002-dea08b812e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:55.198906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:55.300591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 950/1928] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:55.304674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5a4c-5583-4012-b6e7-2a1e2b878c0d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.400906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac5a4c-5583-4012-b6e7-2a1e2b878c0d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.406675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02420986-042c-4955-a073-df22a7bc51c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.407497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02420986-042c-4955-a073-df22a7bc51c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.408455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02420986-042c-4955-a073-df22a7bc51c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.409217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02420986-042c-4955-a073-df22a7bc51c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.409709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02420986-042c-4955-a073-df22a7bc51c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.412047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02420986-042c-4955-a073-df22a7bc51c1 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.452503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 979/1929] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:18:55 2022] POST /identity/v3/projects => generated 363 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:55.454124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66c597-0d73-4d84-a002-dea08b812e0d None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.464838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66c597-0d73-4d84-a002-dea08b812e0d None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.534163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d5319-e99f-4fde-961f-2248b7d33c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.534790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d5319-e99f-4fde-961f-2248b7d33c38 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.535112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d5319-e99f-4fde-961f-2248b7d33c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.535418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464d5319-e99f-4fde-961f-2248b7d33c38 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.536139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d5319-e99f-4fde-961f-2248b7d33c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.538112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464d5319-e99f-4fde-961f-2248b7d33c38 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.571543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 951/1930] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:18:55 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:18:55.575491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02420986-042c-4955-a073-df22a7bc51c1 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.586820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02420986-042c-4955-a073-df22a7bc51c1 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.591583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df36566-090a-4290-914e-4fe3af40c3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.592258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df36566-090a-4290-914e-4fe3af40c3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.592546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df36566-090a-4290-914e-4fe3af40c3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.592829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df36566-090a-4290-914e-4fe3af40c3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.593563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df36566-090a-4290-914e-4fe3af40c3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.595772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df36566-090a-4290-914e-4fe3af40c3d6 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.610069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 980/1931] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:18:55.611492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d5319-e99f-4fde-961f-2248b7d33c38 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.625529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464d5319-e99f-4fde-961f-2248b7d33c38 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.630734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a599e7-d2d8-4fe7-84dd-106020329f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.631659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a599e7-d2d8-4fe7-84dd-106020329f9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.631941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a599e7-d2d8-4fe7-84dd-106020329f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.632217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a599e7-d2d8-4fe7-84dd-106020329f9e admin admin] PATH_INFO: `/v3/projects/8f7d7cb279cb465bb5e62d62f88a23f8/users/611a2e500baf47989e317ce56d36f630/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.648927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a599e7-d2d8-4fe7-84dd-106020329f9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7d7cb279cb465bb5e62d62f88a23f8, user_id=611a2e500baf47989e317ce56d36f630, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.651688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a599e7-d2d8-4fe7-84dd-106020329f9e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.666312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 952/1932] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:55 2022] PUT /identity/v3/projects/8f7d7cb279cb465bb5e62d62f88a23f8/users/611a2e500baf47989e317ce56d36f630/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:55.670332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df36566-090a-4290-914e-4fe3af40c3d6 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.681258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df36566-090a-4290-914e-4fe3af40c3d6 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.733907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:55.741221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bf04bf-25aa-4b4b-b947-c2ca5f0b810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.742036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf04bf-25aa-4b4b-b947-c2ca5f0b810f admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.742408 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf04bf-25aa-4b4b-b947-c2ca5f0b810f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.743142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf04bf-25aa-4b4b-b947-c2ca5f0b810f admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.744136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf04bf-25aa-4b4b-b947-c2ca5f0b810f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.745919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bf04bf-25aa-4b4b-b947-c2ca5f0b810f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.758783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 981/1933] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:18:55.763345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a599e7-d2d8-4fe7-84dd-106020329f9e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.775455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a599e7-d2d8-4fe7-84dd-106020329f9e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:55.780283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f681e6-ad72-4e22-8892-785ce67f0a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:55.781416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f681e6-ad72-4e22-8892-785ce67f0a0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.781707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f681e6-ad72-4e22-8892-785ce67f0a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.782062 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f681e6-ad72-4e22-8892-785ce67f0a0e admin admin] PATH_INFO: `/v3/projects/8f7d7cb279cb465bb5e62d62f88a23f8/users/611a2e500baf47989e317ce56d36f630/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.785226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f681e6-ad72-4e22-8892-785ce67f0a0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7d7cb279cb465bb5e62d62f88a23f8, user_id=611a2e500baf47989e317ce56d36f630, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:55.788100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f681e6-ad72-4e22-8892-785ce67f0a0e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:55.803019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 953/1934] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:18:55 2022] PUT /identity/v3/projects/8f7d7cb279cb465bb5e62d62f88a23f8/users/611a2e500baf47989e317ce56d36f630/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:55.813434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd95a3-0b9d-4967-b9df-a0bc2e28fa2e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:55.813769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd95a3-0b9d-4967-b9df-a0bc2e28fa2e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:55.814203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bd95a3-0b9d-4967-b9df-a0bc2e28fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:55.851585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-f6bd95a3-0b9d-4967-b9df-a0bc2e28fa2e None None] MFA Rules not processed for user `611a2e500baf47989e317ce56d36f630`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:55.852386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f6bd95a3-0b9d-4967-b9df-a0bc2e28fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:55.949095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 982/1935] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:55 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:55.961228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f681e6-ad72-4e22-8892-785ce67f0a0e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:55.963095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-25f681e6-ad72-4e22-8892-785ce67f0a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:56.030688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f681e6-ad72-4e22-8892-785ce67f0a0e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:56.035892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0418d0-9e39-4dd8-959c-76241f42dc37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:56.036568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0418d0-9e39-4dd8-959c-76241f42dc37 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.036922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0418d0-9e39-4dd8-959c-76241f42dc37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.037272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0418d0-9e39-4dd8-959c-76241f42dc37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.048078 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0418d0-9e39-4dd8-959c-76241f42dc37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:56.051157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0418d0-9e39-4dd8-959c-76241f42dc37 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:56.061682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 954/1936] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:55 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:56.156021 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db63b-487a-4334-b1b6-b2bb354a7977 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.156395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db63b-487a-4334-b1b6-b2bb354a7977 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.156774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8db63b-487a-4334-b1b6-b2bb354a7977 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.158948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 983/1937] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:18:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:18:56.176839 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0418d0-9e39-4dd8-959c-76241f42dc37 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:56.187125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7b138-499a-4ad0-8862-16ff069a3d50 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.187125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7b138-499a-4ad0-8862-16ff069a3d50 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.187930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7b138-499a-4ad0-8862-16ff069a3d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.197772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0418d0-9e39-4dd8-959c-76241f42dc37 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:56.207666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4775f-5ad9-468c-aa59-508122259fe7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:56.215119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4775f-5ad9-468c-aa59-508122259fe7 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.215119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4775f-5ad9-468c-aa59-508122259fe7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.215119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4775f-5ad9-468c-aa59-508122259fe7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.216754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ffe7b138-499a-4ad0-8862-16ff069a3d50 None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:56.218192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ffe7b138-499a-4ad0-8862-16ff069a3d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:56.225854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:56.305920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 984/1938] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:18:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:56.311848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4775f-5ad9-468c-aa59-508122259fe7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:56.313789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc4775f-5ad9-468c-aa59-508122259fe7 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:56.324478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7b138-499a-4ad0-8862-16ff069a3d50 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:56.326389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ffe7b138-499a-4ad0-8862-16ff069a3d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:56.327081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 955/1939] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:56 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:18:56.343587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7b138-499a-4ad0-8862-16ff069a3d50 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:56.353677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf5d2ed-aeed-4801-bf0e-de856af42e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:56.354346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5d2ed-aeed-4801-bf0e-de856af42e87 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:56.354624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5d2ed-aeed-4801-bf0e-de856af42e87 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:56.354905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5d2ed-aeed-4801-bf0e-de856af42e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:56.365132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5d2ed-aeed-4801-bf0e-de856af42e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:56.366742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf5d2ed-aeed-4801-bf0e-de856af42e87 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:56.379007 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 985/1940] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:57.735859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4775f-5ad9-468c-aa59-508122259fe7 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:57.737526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-dbc4775f-5ad9-468c-aa59-508122259fe7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:57.808561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4775f-5ad9-468c-aa59-508122259fe7 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:57.814330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:57.815554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:57.815838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:57.816115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] PATH_INFO: `/v3/users/f7bda4732778446193e6da90f8abf341` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:57.817400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7bda4732778446193e6da90f8abf341)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:57.819435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:57.870169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7bda4732778446193e6da90f8abf341'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:57.870827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7bda4732778446193e6da90f8abf341'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:57.871480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7bda4732778446193e6da90f8abf341'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:57.879478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7bda4732778446193e6da90f8abf341'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:57.895321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7bda4732778446193e6da90f8abf341'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:57.919827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 956/1941] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:57 2022] DELETE /identity/v3/users/f7bda4732778446193e6da90f8abf341 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:57.924435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e3173-96d7-422e-96b8-5a9c2382f27e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:57.924967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e3173-96d7-422e-96b8-5a9c2382f27e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:57.925656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0e3173-96d7-422e-96b8-5a9c2382f27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:57.959241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-da0e3173-96d7-422e-96b8-5a9c2382f27e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:57.960954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-da0e3173-96d7-422e-96b8-5a9c2382f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:58.052601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:58.073035 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 986/1942] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:58.090457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:58.092816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:58.145730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:58.197438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be7644-d7d0-47f1-bc00-729251ae5b2c admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:58.209248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43455c-15fa-43d3-90c5-f5c63938da1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:58.209248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43455c-15fa-43d3-90c5-f5c63938da1d service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.209248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43455c-15fa-43d3-90c5-f5c63938da1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.209248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43455c-15fa-43d3-90c5-f5c63938da1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.220561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43455c-15fa-43d3-90c5-f5c63938da1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:58.223476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43455c-15fa-43d3-90c5-f5c63938da1d service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:58.237280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 957/1943] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:18:58.646018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e3173-96d7-422e-96b8-5a9c2382f27e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:58.647564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-da0e3173-96d7-422e-96b8-5a9c2382f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:58.660743 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0e3173-96d7-422e-96b8-5a9c2382f27e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:58.665509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:58.666374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.666675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.666932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] PATH_INFO: `/v3/projects/e65274e20c894362ae02ab575afb4b67` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.670020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e65274e20c894362ae02ab575afb4b67)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:58.671998 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:58.718936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e65274e20c894362ae02ab575afb4b67', 'request_id': 'req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.726249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e65274e20c894362ae02ab575afb4b67', 'request_id': 'req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.731753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e65274e20c894362ae02ab575afb4b67', 'request_id': 'req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.742880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] The token cache is being invalidate because project e65274e20c894362ae02ab575afb4b67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:58.743194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.743821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.745419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 987/1944] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:58 2022] DELETE /identity/v3/projects/e65274e20c894362ae02ab575afb4b67 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:58.749863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43455c-15fa-43d3-90c5-f5c63938da1d service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:58.760057 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43455c-15fa-43d3-90c5-f5c63938da1d service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:58.819503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:58.820555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:58.820791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:58.821093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] PATH_INFO: `/v3/users/843fa354bc424844aa8ec3b52befe0a8` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:58.822315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=843fa354bc424844aa8ec3b52befe0a8)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:58.824375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:58.873908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843fa354bc424844aa8ec3b52befe0a8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.874560 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843fa354bc424844aa8ec3b52befe0a8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.875194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843fa354bc424844aa8ec3b52befe0a8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.882833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843fa354bc424844aa8ec3b52befe0a8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.891031 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843fa354bc424844aa8ec3b52befe0a8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:58.912967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 958/1945] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:58 2022] DELETE /identity/v3/users/843fa354bc424844aa8ec3b52befe0a8 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:59.224220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:59.225850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:59.243295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dab3bc-d4b9-48e6-91d9-7d06f2d8856a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:59.255198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:59.256955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:59.400649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:59.402031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:59.403173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:59.403821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] PATH_INFO: `/v3/users/870a73c24bcf4e53b00f6abf8f255c47` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:59.407460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=870a73c24bcf4e53b00f6abf8f255c47)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:59.410615 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:59.444205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:59.494450 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2f8c4-39b4-4baf-b433-4f035c3da32f admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:59.509847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:59.513147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:59.514396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:59.514396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] PATH_INFO: `/v3/projects/e5b266c7f71f4d1296ffb932a26e23a8` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:59.517354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '870a73c24bcf4e53b00f6abf8f255c47'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.518996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b266c7f71f4d1296ffb932a26e23a8)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:59.519742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '870a73c24bcf4e53b00f6abf8f255c47'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.521814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '870a73c24bcf4e53b00f6abf8f255c47'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.524131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:59.543619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '870a73c24bcf4e53b00f6abf8f255c47'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.565345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-234398b5-3ad3-4ee5-98a4-74a562754e44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '870a73c24bcf4e53b00f6abf8f255c47'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.591571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:18:59.602125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 988/1946] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:59 2022] DELETE /identity/v3/users/870a73c24bcf4e53b00f6abf8f255c47 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:18:59.604768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b251774-eafa-44ff-a9b2-79c38ec837b8 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:59.605486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b251774-eafa-44ff-a9b2-79c38ec837b8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:59.606277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b251774-eafa-44ff-a9b2-79c38ec837b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:59.647276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2b251774-eafa-44ff-a9b2-79c38ec837b8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:59.648770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2b251774-eafa-44ff-a9b2-79c38ec837b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:59.665475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b266c7f71f4d1296ffb932a26e23a8', 'request_id': 'req-b06319a3-8fb0-4e60-85ea-4637892cc00b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.685310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b266c7f71f4d1296ffb932a26e23a8', 'request_id': 'req-b06319a3-8fb0-4e60-85ea-4637892cc00b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.696929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b266c7f71f4d1296ffb932a26e23a8', 'request_id': 'req-b06319a3-8fb0-4e60-85ea-4637892cc00b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.716906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] The token cache is being invalidate because project e5b266c7f71f4d1296ffb932a26e23a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:18:59.717305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.721458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:18:59.723907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 959/1947] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:18:59 2022] DELETE /identity/v3/projects/e5b266c7f71f4d1296ffb932a26e23a8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:18:59.726874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:59.729387 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:59.795424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 989/1948] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:59.797295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ca75e-57b4-4992-b742-a0a295e81e4a None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:59.797801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ca75e-57b4-4992-b742-a0a295e81e4a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:59.803571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ca75e-57b4-4992-b742-a0a295e81e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:59.841618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-137ca75e-57b4-4992-b742-a0a295e81e4a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:18:59.843315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-137ca75e-57b4-4992-b742-a0a295e81e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:59.863441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 990/1949] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:18:59.873096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ca75e-57b4-4992-b742-a0a295e81e4a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:18:59.876059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-137ca75e-57b4-4992-b742-a0a295e81e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:18:59.908246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06319a3-8fb0-4e60-85ea-4637892cc00b admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:59.919803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:59.920704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:59.921002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:59.921346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] PATH_INFO: `/v3/users/a6b08ca66c914c4d9aad187ec8a611a5` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:18:59.924977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b08ca66c914c4d9aad187ec8a611a5)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:18:59.926871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:18:59.980991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ca75e-57b4-4992-b742-a0a295e81e4a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:18:59.987087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0c54d-8e33-49e7-8758-7a9ba2dc0a8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:18:59.988261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c54d-8e33-49e7-8758-7a9ba2dc0a8a service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:18:59.988795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c54d-8e33-49e7-8758-7a9ba2dc0a8a service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:18:59.989226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0c54d-8e33-49e7-8758-7a9ba2dc0a8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.014924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0c54d-8e33-49e7-8758-7a9ba2dc0a8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.016437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0c54d-8e33-49e7-8758-7a9ba2dc0a8a service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.025498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b08ca66c914c4d9aad187ec8a611a5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.027343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b08ca66c914c4d9aad187ec8a611a5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.028701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b08ca66c914c4d9aad187ec8a611a5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.039330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 991/1950] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:00.040564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b08ca66c914c4d9aad187ec8a611a5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.041685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a717e0b-c429-449d-9a1e-2a3e2ffe5e92 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.042519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a717e0b-c429-449d-9a1e-2a3e2ffe5e92 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.043054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a717e0b-c429-449d-9a1e-2a3e2ffe5e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.051983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8dabc3f4-6fa1-4e73-bf5c-9acacc01380a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b08ca66c914c4d9aad187ec8a611a5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.068744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:00.078218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 960/1951] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:18:59 2022] DELETE /identity/v3/users/a6b08ca66c914c4d9aad187ec8a611a5 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:00.083698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21ecc8-c67f-4111-90cc-1fc81d5c0ceb None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.083991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21ecc8-c67f-4111-90cc-1fc81d5c0ceb None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.084279 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd21ecc8-c67f-4111-90cc-1fc81d5c0ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.086254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-8a717e0b-c429-449d-9a1e-2a3e2ffe5e92 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:00.088109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8a717e0b-c429-449d-9a1e-2a3e2ffe5e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.108082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-cd21ecc8-c67f-4111-90cc-1fc81d5c0ceb None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:00.109447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-cd21ecc8-c67f-4111-90cc-1fc81d5c0ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.202645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 992/1952] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:00.217078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a717e0b-c429-449d-9a1e-2a3e2ffe5e92 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.233663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a717e0b-c429-449d-9a1e-2a3e2ffe5e92 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.252414 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eead05-e9ee-40dc-8442-e10894fb8806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.254605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eead05-e9ee-40dc-8442-e10894fb8806 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.254770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eead05-e9ee-40dc-8442-e10894fb8806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.255043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eead05-e9ee-40dc-8442-e10894fb8806 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.256968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eead05-e9ee-40dc-8442-e10894fb8806 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:00.257620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 961/1953] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:00.261023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eead05-e9ee-40dc-8442-e10894fb8806 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.262795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eead05-e9ee-40dc-8442-e10894fb8806 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.291687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 993/1954] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:00.293251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21ecc8-c67f-4111-90cc-1fc81d5c0ceb None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.304908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eead05-e9ee-40dc-8442-e10894fb8806 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.308162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-93eead05-e9ee-40dc-8442-e10894fb8806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.311960 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd21ecc8-c67f-4111-90cc-1fc81d5c0ceb None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.321021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a304c-5622-4704-bdc1-c0072140ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.322503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a304c-5622-4704-bdc1-c0072140ec8c admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.323639 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a304c-5622-4704-bdc1-c0072140ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.324621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a304c-5622-4704-bdc1-c0072140ec8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.328373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a304c-5622-4704-bdc1-c0072140ec8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.334785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a304c-5622-4704-bdc1-c0072140ec8c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.381829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:00.397570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 962/1955] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:00 2022] POST /identity/v3/projects => generated 369 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:00.401644 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a304c-5622-4704-bdc1-c0072140ec8c admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.456061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eead05-e9ee-40dc-8442-e10894fb8806 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.543775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a304c-5622-4704-bdc1-c0072140ec8c admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.550229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd711d9-9570-4cf0-8c1d-f08906092ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.551176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd711d9-9570-4cf0-8c1d-f08906092ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.551453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd711d9-9570-4cf0-8c1d-f08906092ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.551835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd711d9-9570-4cf0-8c1d-f08906092ae0 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.552615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd711d9-9570-4cf0-8c1d-f08906092ae0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.554844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd711d9-9570-4cf0-8c1d-f08906092ae0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.559793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76646b6d-bc8d-4bb3-82e1-5bf3ff99ca79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.561541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76646b6d-bc8d-4bb3-82e1-5bf3ff99ca79 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.561541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76646b6d-bc8d-4bb3-82e1-5bf3ff99ca79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.561898 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76646b6d-bc8d-4bb3-82e1-5bf3ff99ca79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.577378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76646b6d-bc8d-4bb3-82e1-5bf3ff99ca79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.578924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76646b6d-bc8d-4bb3-82e1-5bf3ff99ca79 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.592095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 963/1956] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:00 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:00.596119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd711d9-9570-4cf0-8c1d-f08906092ae0 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.602790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 994/1957] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:00.612583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd711d9-9570-4cf0-8c1d-f08906092ae0 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.619216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548483a2-cbbc-4fe6-a0b4-c02c2992eec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.621330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548483a2-cbbc-4fe6-a0b4-c02c2992eec2 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.643340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548483a2-cbbc-4fe6-a0b4-c02c2992eec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.645085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548483a2-cbbc-4fe6-a0b4-c02c2992eec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.649420 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548483a2-cbbc-4fe6-a0b4-c02c2992eec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.654012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548483a2-cbbc-4fe6-a0b4-c02c2992eec2 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.708242 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 964/1958] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:00.712360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76646b6d-bc8d-4bb3-82e1-5bf3ff99ca79 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.728228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76646b6d-bc8d-4bb3-82e1-5bf3ff99ca79 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.737322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314161d-c311-45c0-98e3-943432050f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.738101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314161d-c311-45c0-98e3-943432050f0c admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.738394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314161d-c311-45c0-98e3-943432050f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.738676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0314161d-c311-45c0-98e3-943432050f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.739506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314161d-c311-45c0-98e3-943432050f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.742058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0314161d-c311-45c0-98e3-943432050f0c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.763060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 995/1959] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:00.767727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548483a2-cbbc-4fe6-a0b4-c02c2992eec2 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.784149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548483a2-cbbc-4fe6-a0b4-c02c2992eec2 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.791807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314161d-c311-45c0-98e3-943432050f0c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:00.798511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d85086-6c7b-47be-a4aa-6fc913ff4dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.799728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85086-6c7b-47be-a4aa-6fc913ff4dcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.800926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85086-6c7b-47be-a4aa-6fc913ff4dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.801314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d85086-6c7b-47be-a4aa-6fc913ff4dcd admin admin] PATH_INFO: `/v3/projects/7da764d7d6df48508153ffd0007f9bb1/users/cd1c97e7ceb0407d8947e51f1bfaa559/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.817411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0314161d-c311-45c0-98e3-943432050f0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.849065 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0314161d-c311-45c0-98e3-943432050f0c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:00.849659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d85086-6c7b-47be-a4aa-6fc913ff4dcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da764d7d6df48508153ffd0007f9bb1, user_id=cd1c97e7ceb0407d8947e51f1bfaa559, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.853165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d85086-6c7b-47be-a4aa-6fc913ff4dcd admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.867346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:00.868825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.869442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.871394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] PATH_INFO: `/v3/projects/e17875523bd04c2cabeff784e5d069d1` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.873915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17875523bd04c2cabeff784e5d069d1)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:00.876872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:00.877508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 965/1960] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:00 2022] PUT /identity/v3/projects/7da764d7d6df48508153ffd0007f9bb1/users/cd1c97e7ceb0407d8947e51f1bfaa559/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:00.888933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc178425-68ba-4154-a740-10d8276a95c7 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:00.889243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc178425-68ba-4154-a740-10d8276a95c7 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:00.889508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc178425-68ba-4154-a740-10d8276a95c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:00.941632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-bc178425-68ba-4154-a740-10d8276a95c7 None None] MFA Rules not processed for user `cd1c97e7ceb0407d8947e51f1bfaa559`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:00.942964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bc178425-68ba-4154-a740-10d8276a95c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:00.973249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17875523bd04c2cabeff784e5d069d1', 'request_id': 'req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.983197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17875523bd04c2cabeff784e5d069d1', 'request_id': 'req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:00.988040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:00.993106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17875523bd04c2cabeff784e5d069d1', 'request_id': 'req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.010386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] The token cache is being invalidate because project e17875523bd04c2cabeff784e5d069d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:01.010881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.011872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.013863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 996/1961] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:00 2022] DELETE /identity/v3/projects/e17875523bd04c2cabeff784e5d069d1 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:01.017990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.021081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.082907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 966/1962] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:00 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:01.092869 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc178425-68ba-4154-a740-10d8276a95c7 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.099910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bc178425-68ba-4154-a740-10d8276a95c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.138856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:01.155117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3eb6b7-8e5e-49a4-b2eb-672fba773c8c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.178692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.179654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.179937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.180213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] PATH_INFO: `/v3/users/611a2e500baf47989e317ce56d36f630` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.191219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=611a2e500baf47989e317ce56d36f630)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.200445 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.233558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc178425-68ba-4154-a740-10d8276a95c7 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.239582 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987bb21-ac56-493c-a6ef-6a3e579f3b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.240423 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987bb21-ac56-493c-a6ef-6a3e579f3b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.241240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987bb21-ac56-493c-a6ef-6a3e579f3b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.241603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987bb21-ac56-493c-a6ef-6a3e579f3b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.242456 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987bb21-ac56-493c-a6ef-6a3e579f3b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.244436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987bb21-ac56-493c-a6ef-6a3e579f3b9e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.283900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '611a2e500baf47989e317ce56d36f630'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.284914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '611a2e500baf47989e317ce56d36f630'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.285678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '611a2e500baf47989e317ce56d36f630'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.287365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 967/1963] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/projects => generated 367 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:01.288393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987bb21-ac56-493c-a6ef-6a3e579f3b9e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.290263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7987bb21-ac56-493c-a6ef-6a3e579f3b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.294519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '611a2e500baf47989e317ce56d36f630'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.305687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '611a2e500baf47989e317ce56d36f630'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.333191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 997/1964] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:01 2022] DELETE /identity/v3/users/611a2e500baf47989e317ce56d36f630 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:01.334824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.336718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.373512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987bb21-ac56-493c-a6ef-6a3e579f3b9e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.417906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb1709c-a771-40c1-8da6-584408b9df26 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.424815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cac196-1095-46c6-b697-1cc0af261928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.425509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cac196-1095-46c6-b697-1cc0af261928 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.425945 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cac196-1095-46c6-b697-1cc0af261928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.426226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cac196-1095-46c6-b697-1cc0af261928 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.426994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cac196-1095-46c6-b697-1cc0af261928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.428933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cac196-1095-46c6-b697-1cc0af261928 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.437813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:01.455675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 998/1965] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/users => generated 290 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:01.459045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cac196-1095-46c6-b697-1cc0af261928 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.460315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.461490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.462143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.463094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] PATH_INFO: `/v3/projects/c698637ed2c14482a38796df553afa1e` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.464366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c698637ed2c14482a38796df553afa1e)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.467471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.470993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cac196-1095-46c6-b697-1cc0af261928 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.480425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e13c-f15c-4277-aaa8-6c2c9ed761ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.481399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e13c-f15c-4277-aaa8-6c2c9ed761ac admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.481839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e13c-f15c-4277-aaa8-6c2c9ed761ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.482191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268e13c-f15c-4277-aaa8-6c2c9ed761ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.483197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268e13c-f15c-4277-aaa8-6c2c9ed761ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.485803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5268e13c-f15c-4277-aaa8-6c2c9ed761ac admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.498656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 999/1966] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:01.503650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e13c-f15c-4277-aaa8-6c2c9ed761ac admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.515113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268e13c-f15c-4277-aaa8-6c2c9ed761ac admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.529648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c698637ed2c14482a38796df553afa1e', 'request_id': 'req-6441079d-477a-431b-83d2-91ba454b8c25'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.540270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c698637ed2c14482a38796df553afa1e', 'request_id': 'req-6441079d-477a-431b-83d2-91ba454b8c25'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.548120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c698637ed2c14482a38796df553afa1e', 'request_id': 'req-6441079d-477a-431b-83d2-91ba454b8c25'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.574615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] The token cache is being invalidate because project c698637ed2c14482a38796df553afa1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:01.575268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.576462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6441079d-477a-431b-83d2-91ba454b8c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:01.579680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 968/1967] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:01 2022] DELETE /identity/v3/projects/c698637ed2c14482a38796df553afa1e => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:01.581018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:01.584821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7983-23e0-4565-8612-9f4afd7eb8ca None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.585281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7983-23e0-4565-8612-9f4afd7eb8ca None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.585542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb7983-23e0-4565-8612-9f4afd7eb8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.600979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62689-bf04-4b27-ad2a-18c247e7472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.602005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62689-bf04-4b27-ad2a-18c247e7472d admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.602349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62689-bf04-4b27-ad2a-18c247e7472d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.602694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b62689-bf04-4b27-ad2a-18c247e7472d admin admin] PATH_INFO: `/v3/projects/19b440b3053e494884e521064cf5ea54/users/9a98d4a0a4df49faba0901754d951515/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.608449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e0fb7983-23e0-4565-8612-9f4afd7eb8ca None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:01.609745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e0fb7983-23e0-4565-8612-9f4afd7eb8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.620448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 969/1968] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:01.628887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d963ecb-893f-456c-a8ab-b005f86b8755 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.629270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d963ecb-893f-456c-a8ab-b005f86b8755 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.629491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d963ecb-893f-456c-a8ab-b005f86b8755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.634113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b62689-bf04-4b27-ad2a-18c247e7472d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b440b3053e494884e521064cf5ea54, user_id=9a98d4a0a4df49faba0901754d951515, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.638366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b62689-bf04-4b27-ad2a-18c247e7472d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.649693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1d963ecb-893f-456c-a8ab-b005f86b8755 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:01.651058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1d963ecb-893f-456c-a8ab-b005f86b8755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.655778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1000/1969] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:01 2022] PUT /identity/v3/projects/19b440b3053e494884e521064cf5ea54/users/9a98d4a0a4df49faba0901754d951515/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:01.661648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62689-bf04-4b27-ad2a-18c247e7472d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.664490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-32b62689-bf04-4b27-ad2a-18c247e7472d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.759719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 970/1970] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:01.762270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d963ecb-893f-456c-a8ab-b005f86b8755 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.799137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b62689-bf04-4b27-ad2a-18c247e7472d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.799838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d963ecb-893f-456c-a8ab-b005f86b8755 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.808097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdd420-8c83-4751-bce3-29bf2ae9459f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.808437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdd420-8c83-4751-bce3-29bf2ae9459f admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.808762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdd420-8c83-4751-bce3-29bf2ae9459f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.809347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fdd420-8c83-4751-bce3-29bf2ae9459f admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.810659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e9983-9cb1-4776-a32b-46c463509992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.810986 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdd420-8c83-4751-bce3-29bf2ae9459f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:01.811685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdd420-8c83-4751-bce3-29bf2ae9459f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.811879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e9983-9cb1-4776-a32b-46c463509992 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.812586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e9983-9cb1-4776-a32b-46c463509992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.813014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e9983-9cb1-4776-a32b-46c463509992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.814207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e9983-9cb1-4776-a32b-46c463509992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.815427 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fdd420-8c83-4751-bce3-29bf2ae9459f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.816225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e9983-9cb1-4776-a32b-46c463509992 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.828697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1001/1971] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:01 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:01.830861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 971/1972] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:19:01.832878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e9983-9cb1-4776-a32b-46c463509992 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.835929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdd420-8c83-4751-bce3-29bf2ae9459f admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.849673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e9983-9cb1-4776-a32b-46c463509992 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.850409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fdd420-8c83-4751-bce3-29bf2ae9459f admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:01.856201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a08fd-24ae-48cb-9555-8d04294679bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.856658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba588d-eaa3-41d0-9eca-92e063f86181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:01.857115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a08fd-24ae-48cb-9555-8d04294679bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.857403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a08fd-24ae-48cb-9555-8d04294679bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.857526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba588d-eaa3-41d0-9eca-92e063f86181 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.857824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a08fd-24ae-48cb-9555-8d04294679bd admin admin] PATH_INFO: `/v3/projects/19b440b3053e494884e521064cf5ea54/users/9a98d4a0a4df49faba0901754d951515/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.858265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba588d-eaa3-41d0-9eca-92e063f86181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.858653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba588d-eaa3-41d0-9eca-92e063f86181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.859455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba588d-eaa3-41d0-9eca-92e063f86181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.861533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a08fd-24ae-48cb-9555-8d04294679bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b440b3053e494884e521064cf5ea54, user_id=9a98d4a0a4df49faba0901754d951515, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:01.862313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba588d-eaa3-41d0-9eca-92e063f86181 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.867042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a08fd-24ae-48cb-9555-8d04294679bd admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:01.885927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1002/1973] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:01 2022] PUT /identity/v3/projects/19b440b3053e494884e521064cf5ea54/users/9a98d4a0a4df49faba0901754d951515/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:01.897875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76466b2a-fb52-40ea-b32c-66f653b6a76b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:01.898314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76466b2a-fb52-40ea-b32c-66f653b6a76b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:01.898608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76466b2a-fb52-40ea-b32c-66f653b6a76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:01.911603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 972/1974] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/projects => generated 383 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:01.912753 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba588d-eaa3-41d0-9eca-92e063f86181 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:01.958880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-76466b2a-fb52-40ea-b32c-66f653b6a76b None None] MFA Rules not processed for user `9a98d4a0a4df49faba0901754d951515`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:01.960692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-76466b2a-fb52-40ea-b32c-66f653b6a76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:01.985387 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:02.015381 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba588d-eaa3-41d0-9eca-92e063f86181 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.023518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0fb77-e999-4ddf-b6ea-6e8e4a05550b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.024387 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0fb77-e999-4ddf-b6ea-6e8e4a05550b admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.024740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0fb77-e999-4ddf-b6ea-6e8e4a05550b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.025013 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0fb77-e999-4ddf-b6ea-6e8e4a05550b admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.025789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0fb77-e999-4ddf-b6ea-6e8e4a05550b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.028765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0fb77-e999-4ddf-b6ea-6e8e4a05550b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.059050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 973/1975] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/users => generated 292 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:02.065906 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0fb77-e999-4ddf-b6ea-6e8e4a05550b admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.081725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0fb77-e999-4ddf-b6ea-6e8e4a05550b admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.087868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09212539-e0e4-4baf-8cc7-57ffde5345dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.092398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212539-e0e4-4baf-8cc7-57ffde5345dc admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.092672 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1003/1976] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:01 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:02.092765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212539-e0e4-4baf-8cc7-57ffde5345dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.092765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09212539-e0e4-4baf-8cc7-57ffde5345dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.092765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09212539-e0e4-4baf-8cc7-57ffde5345dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.092991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76466b2a-fb52-40ea-b32c-66f653b6a76b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.093075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09212539-e0e4-4baf-8cc7-57ffde5345dc admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.096491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-76466b2a-fb52-40ea-b32c-66f653b6a76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.115012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 974/1977] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:02.115679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09212539-e0e4-4baf-8cc7-57ffde5345dc admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.118934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76466b2a-fb52-40ea-b32c-66f653b6a76b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.119163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-09212539-e0e4-4baf-8cc7-57ffde5345dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.124086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.125091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.125458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.125858 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] PATH_INFO: `/v3/projects/8f7d7cb279cb465bb5e62d62f88a23f8` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.128962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7d7cb279cb465bb5e62d62f88a23f8)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.131207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.179417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:02.198050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7d7cb279cb465bb5e62d62f88a23f8', 'request_id': 'req-7f765ca3-1c79-4376-ad4e-9c135052347a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:02.204846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09212539-e0e4-4baf-8cc7-57ffde5345dc admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.215816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7d7cb279cb465bb5e62d62f88a23f8', 'request_id': 'req-7f765ca3-1c79-4376-ad4e-9c135052347a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:02.242022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7d7cb279cb465bb5e62d62f88a23f8', 'request_id': 'req-7f765ca3-1c79-4376-ad4e-9c135052347a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:02.257031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] The token cache is being invalidate because project 8f7d7cb279cb465bb5e62d62f88a23f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:02.257434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:02.258244 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:02.260488 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1004/1978] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:02 2022] DELETE /identity/v3/projects/8f7d7cb279cb465bb5e62d62f88a23f8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:02.265337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.267721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.311154 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7776e7b6-8525-40cf-96fe-57dee8eefa10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.311887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776e7b6-8525-40cf-96fe-57dee8eefa10 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.313212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776e7b6-8525-40cf-96fe-57dee8eefa10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.314182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7776e7b6-8525-40cf-96fe-57dee8eefa10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.320383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7776e7b6-8525-40cf-96fe-57dee8eefa10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.378878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f765ca3-1c79-4376-ad4e-9c135052347a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.389015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f875e9a-6b80-4cf9-a6bb-f2384e4211a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.389704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f875e9a-6b80-4cf9-a6bb-f2384e4211a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.394382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f875e9a-6b80-4cf9-a6bb-f2384e4211a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.394676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f875e9a-6b80-4cf9-a6bb-f2384e4211a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.396841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f875e9a-6b80-4cf9-a6bb-f2384e4211a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.398521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f875e9a-6b80-4cf9-a6bb-f2384e4211a9 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.415380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1005/1979] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:02.417184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a698a-1ced-4547-9bae-607365a7a1e3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.417482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a698a-1ced-4547-9bae-607365a7a1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.417771 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42a698a-1ced-4547-9bae-607365a7a1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.442295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b42a698a-1ced-4547-9bae-607365a7a1e3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:02.443312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776e7b6-8525-40cf-96fe-57dee8eefa10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.443794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b42a698a-1ced-4547-9bae-607365a7a1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.445690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7776e7b6-8525-40cf-96fe-57dee8eefa10 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.459080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1006/1980] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:02.464127 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a698a-1ced-4547-9bae-607365a7a1e3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.473418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 975/1981] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:02 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:02.475478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314ed6a-a7b1-4086-9c4f-a1134095ff64 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.475917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314ed6a-a7b1-4086-9c4f-a1134095ff64 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.476367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c314ed6a-a7b1-4086-9c4f-a1134095ff64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.486193 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42a698a-1ced-4547-9bae-607365a7a1e3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.493526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e631f-aea4-463c-b0a5-9d6b8309ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.495004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e631f-aea4-463c-b0a5-9d6b8309ca17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.495393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e631f-aea4-463c-b0a5-9d6b8309ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.495766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e631f-aea4-463c-b0a5-9d6b8309ca17 admin admin] PATH_INFO: `/v3/projects/e0a5979121554841af71a07e290d748f/users/d9657672b0424549b3b7dc31cd5c26d7/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.504565 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c314ed6a-a7b1-4086-9c4f-a1134095ff64 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:02.506001 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c314ed6a-a7b1-4086-9c4f-a1134095ff64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.518926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 976/1982] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:02.523714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314ed6a-a7b1-4086-9c4f-a1134095ff64 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.524203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e631f-aea4-463c-b0a5-9d6b8309ca17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a5979121554841af71a07e290d748f, user_id=d9657672b0424549b3b7dc31cd5c26d7, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.527650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73e631f-aea4-463c-b0a5-9d6b8309ca17 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.537317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c314ed6a-a7b1-4086-9c4f-a1134095ff64 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.544464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1007/1983] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:02 2022] PUT /identity/v3/projects/e0a5979121554841af71a07e290d748f/users/d9657672b0424549b3b7dc31cd5c26d7/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:02.545291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e631f-aea4-463c-b0a5-9d6b8309ca17 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.546865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c73e631f-aea4-463c-b0a5-9d6b8309ca17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.569310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:02.642903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e631f-aea4-463c-b0a5-9d6b8309ca17 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.646835 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cba4d1-068a-4280-91dc-c579716a75e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.647565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cba4d1-068a-4280-91dc-c579716a75e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.647819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cba4d1-068a-4280-91dc-c579716a75e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.648171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cba4d1-068a-4280-91dc-c579716a75e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.650073 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c8cba4d1-068a-4280-91dc-c579716a75e5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.660933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c1d06-63d2-4274-a5ed-8b1f9d4ab616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.661728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c1d06-63d2-4274-a5ed-8b1f9d4ab616 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.662083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c1d06-63d2-4274-a5ed-8b1f9d4ab616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.662431 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c1d06-63d2-4274-a5ed-8b1f9d4ab616 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.663321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c1d06-63d2-4274-a5ed-8b1f9d4ab616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:02.663613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c1d06-63d2-4274-a5ed-8b1f9d4ab616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.665423 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c1d06-63d2-4274-a5ed-8b1f9d4ab616 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.678039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 977/1984] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:02.679361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85809fd7-afe0-4136-a9d9-93425465ce1a None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.679654 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85809fd7-afe0-4136-a9d9-93425465ce1a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.679937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85809fd7-afe0-4136-a9d9-93425465ce1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.709950 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:02.711038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-85809fd7-afe0-4136-a9d9-93425465ce1a None None] MFA Rules not processed for user `d9657672b0424549b3b7dc31cd5c26d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:02.712517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-85809fd7-afe0-4136-a9d9-93425465ce1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:02.727798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cba4d1-068a-4280-91dc-c579716a75e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.729791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cba4d1-068a-4280-91dc-c579716a75e5 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.742524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1008/1985] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:02 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:02.743745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cba4d1-068a-4280-91dc-c579716a75e5 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.763721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cba4d1-068a-4280-91dc-c579716a75e5 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.770392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b94bf8-2c34-4811-a54b-3b6351d05b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.771126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b94bf8-2c34-4811-a54b-3b6351d05b77 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.771364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b94bf8-2c34-4811-a54b-3b6351d05b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.771641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b94bf8-2c34-4811-a54b-3b6351d05b77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.772480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b94bf8-2c34-4811-a54b-3b6351d05b77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.774439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b94bf8-2c34-4811-a54b-3b6351d05b77 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.793280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 978/1986] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:02.799119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85809fd7-afe0-4136-a9d9-93425465ce1a None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.812870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85809fd7-afe0-4136-a9d9-93425465ce1a None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.818624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2629-29cd-42c1-b639-f70561d9278e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:02.820191 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2629-29cd-42c1-b639-f70561d9278e admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:02.820648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2629-29cd-42c1-b639-f70561d9278e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:02.821070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be2629-29cd-42c1-b639-f70561d9278e admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:02.821839 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be2629-29cd-42c1-b639-f70561d9278e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:02.822990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1009/1987] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:02 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:02.824249 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be2629-29cd-42c1-b639-f70561d9278e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:02.826923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b94bf8-2c34-4811-a54b-3b6351d05b77 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.861758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 979/1988] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:02 2022] POST /identity/v3/projects => generated 385 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:02.864198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2629-29cd-42c1-b639-f70561d9278e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:02.933543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b94bf8-2c34-4811-a54b-3b6351d05b77 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:02.981642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be2629-29cd-42c1-b639-f70561d9278e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.000317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cb4b8-8fd7-46db-8aa5-1f727dbdef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.002974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cb4b8-8fd7-46db-8aa5-1f727dbdef54 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.003365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cb4b8-8fd7-46db-8aa5-1f727dbdef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.003711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500cb4b8-8fd7-46db-8aa5-1f727dbdef54 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.005316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cb4b8-8fd7-46db-8aa5-1f727dbdef54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.007512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500cb4b8-8fd7-46db-8aa5-1f727dbdef54 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.019737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15707-0f18-4c16-ae0d-30d39c6272de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.020761 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15707-0f18-4c16-ae0d-30d39c6272de admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.021280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15707-0f18-4c16-ae0d-30d39c6272de admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.021930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f15707-0f18-4c16-ae0d-30d39c6272de admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.023044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f15707-0f18-4c16-ae0d-30d39c6272de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.029782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f15707-0f18-4c16-ae0d-30d39c6272de admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.034993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 980/1989] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:02 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:03.037802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cb4b8-8fd7-46db-8aa5-1f727dbdef54 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.062457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500cb4b8-8fd7-46db-8aa5-1f727dbdef54 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.069780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1010/1990] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:02 2022] POST /identity/v3/users => generated 292 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:03.071678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15707-0f18-4c16-ae0d-30d39c6272de admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.075465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888daac1-69cf-4347-bc84-b6141c64f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.076221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888daac1-69cf-4347-bc84-b6141c64f967 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.076613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888daac1-69cf-4347-bc84-b6141c64f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.077446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888daac1-69cf-4347-bc84-b6141c64f967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.078258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888daac1-69cf-4347-bc84-b6141c64f967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.080998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888daac1-69cf-4347-bc84-b6141c64f967 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.084984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:03.101602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f15707-0f18-4c16-ae0d-30d39c6272de admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.105569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 981/1991] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:03.107189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888daac1-69cf-4347-bc84-b6141c64f967 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.117387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07668f-5b3e-4ad4-b600-11f90909e334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.118201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07668f-5b3e-4ad4-b600-11f90909e334 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.118647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07668f-5b3e-4ad4-b600-11f90909e334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.120849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07668f-5b3e-4ad4-b600-11f90909e334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.121192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888daac1-69cf-4347-bc84-b6141c64f967 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.124936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07668f-5b3e-4ad4-b600-11f90909e334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.127508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07668f-5b3e-4ad4-b600-11f90909e334 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.128073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ff648-c29a-4594-89f5-2c79ff4d4ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.128859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ff648-c29a-4594-89f5-2c79ff4d4ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.129253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ff648-c29a-4594-89f5-2c79ff4d4ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.129657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ff648-c29a-4594-89f5-2c79ff4d4ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.130467 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ff648-c29a-4594-89f5-2c79ff4d4ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.133696 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ff648-c29a-4594-89f5-2c79ff4d4ac7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.157115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1011/1992] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:03.157787 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 982/1993] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:03.157870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07668f-5b3e-4ad4-b600-11f90909e334 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.159478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ff648-c29a-4594-89f5-2c79ff4d4ac7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.182738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ff648-c29a-4594-89f5-2c79ff4d4ac7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.185548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07668f-5b3e-4ad4-b600-11f90909e334 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.195726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af92cfc-21e9-49a7-b55b-ddc490098cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.196321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af92cfc-21e9-49a7-b55b-ddc490098cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.196595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af92cfc-21e9-49a7-b55b-ddc490098cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.196870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af92cfc-21e9-49a7-b55b-ddc490098cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.197631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af92cfc-21e9-49a7-b55b-ddc490098cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.200557 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af92cfc-21e9-49a7-b55b-ddc490098cf4 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.215993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb97ba-c746-4478-ade9-d12fb4a27c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.216920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb97ba-c746-4478-ade9-d12fb4a27c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.217208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb97ba-c746-4478-ade9-d12fb4a27c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.217487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb97ba-c746-4478-ade9-d12fb4a27c10 admin admin] PATH_INFO: `/v3/projects/d0bab834e0d74b9d919f57a131c981e3/users/557884f4849a4511902ed5c5b24e4b21/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.222992 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1012/1994] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:03.226257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af92cfc-21e9-49a7-b55b-ddc490098cf4 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.243280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af92cfc-21e9-49a7-b55b-ddc490098cf4 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.251460 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb97ba-c746-4478-ade9-d12fb4a27c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0bab834e0d74b9d919f57a131c981e3, user_id=557884f4849a4511902ed5c5b24e4b21, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.254089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afd265-9cb6-44f4-a51b-5775dac63600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.254633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb97ba-c746-4478-ade9-d12fb4a27c10 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.255546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd265-9cb6-44f4-a51b-5775dac63600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.255828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd265-9cb6-44f4-a51b-5775dac63600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.256102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afd265-9cb6-44f4-a51b-5775dac63600 admin admin] PATH_INFO: `/v3/projects/6add11c8c9164ce29cbe10929cf1742c/users/53b28d6e10644cb299db6cff8c8828ea/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.272037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 983/1995] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:03 2022] PUT /identity/v3/projects/d0bab834e0d74b9d919f57a131c981e3/users/557884f4849a4511902ed5c5b24e4b21/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:03.284341 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e4349-e91d-4a3a-85ab-eeba7c8bf8cd None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.284631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e4349-e91d-4a3a-85ab-eeba7c8bf8cd None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.284971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e4349-e91d-4a3a-85ab-eeba7c8bf8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.289971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afd265-9cb6-44f4-a51b-5775dac63600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6add11c8c9164ce29cbe10929cf1742c, user_id=53b28d6e10644cb299db6cff8c8828ea, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.292749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90afd265-9cb6-44f4-a51b-5775dac63600 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.310029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1013/1996] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:03 2022] PUT /identity/v3/projects/6add11c8c9164ce29cbe10929cf1742c/users/53b28d6e10644cb299db6cff8c8828ea/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:03.314589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-2f9e4349-e91d-4a3a-85ab-eeba7c8bf8cd None None] MFA Rules not processed for user `557884f4849a4511902ed5c5b24e4b21`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:03.315912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2f9e4349-e91d-4a3a-85ab-eeba7c8bf8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:03.321136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220f2cb-de84-4bf1-b87d-97b894d4c2e0 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.321516 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220f2cb-de84-4bf1-b87d-97b894d4c2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.321802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220f2cb-de84-4bf1-b87d-97b894d4c2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.347824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c220f2cb-de84-4bf1-b87d-97b894d4c2e0 None None] MFA Rules not processed for user `53b28d6e10644cb299db6cff8c8828ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:03.349090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c220f2cb-de84-4bf1-b87d-97b894d4c2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:03.353389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:03.384593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 984/1997] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:03.389104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e4349-e91d-4a3a-85ab-eeba7c8bf8cd None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.416574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1014/1998] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:03.420879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220f2cb-de84-4bf1-b87d-97b894d4c2e0 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.454753 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e4349-e91d-4a3a-85ab-eeba7c8bf8cd None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.459301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f94ca-f8ca-4097-8866-a355cfac4e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.459957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f94ca-f8ca-4097-8866-a355cfac4e7b admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.460255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f94ca-f8ca-4097-8866-a355cfac4e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.460520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f94ca-f8ca-4097-8866-a355cfac4e7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.461204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f94ca-f8ca-4097-8866-a355cfac4e7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.463140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025f94ca-f8ca-4097-8866-a355cfac4e7b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.484669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220f2cb-de84-4bf1-b87d-97b894d4c2e0 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.490685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4940bc9-288b-4482-98a0-f560a2e02899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.491390 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940bc9-288b-4482-98a0-f560a2e02899 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.491678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940bc9-288b-4482-98a0-f560a2e02899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.491958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4940bc9-288b-4482-98a0-f560a2e02899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.492429 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 985/1999] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:03 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:03.495643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4940bc9-288b-4482-98a0-f560a2e02899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.496355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f94ca-f8ca-4097-8866-a355cfac4e7b admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.497749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4940bc9-288b-4482-98a0-f560a2e02899 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.526809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1015/2000] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:03 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:03.531096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4940bc9-288b-4482-98a0-f560a2e02899 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.542877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:03.569477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f94ca-f8ca-4097-8866-a355cfac4e7b admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.616560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4940bc9-288b-4482-98a0-f560a2e02899 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.624441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333959db-7919-4af1-91b3-6298d8d1e8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.625625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333959db-7919-4af1-91b3-6298d8d1e8b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.626977 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333959db-7919-4af1-91b3-6298d8d1e8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.627721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333959db-7919-4af1-91b3-6298d8d1e8b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.628702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333959db-7919-4af1-91b3-6298d8d1e8b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.631815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333959db-7919-4af1-91b3-6298d8d1e8b4 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.648944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d761f-3a84-41c1-a224-f3e6f48ee1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.649955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d761f-3a84-41c1-a224-f3e6f48ee1df admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.653129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d761f-3a84-41c1-a224-f3e6f48ee1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.654226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468d761f-3a84-41c1-a224-f3e6f48ee1df admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.655125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d761f-3a84-41c1-a224-f3e6f48ee1df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.659711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468d761f-3a84-41c1-a224-f3e6f48ee1df admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.663486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1016/2001] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:03 2022] POST /identity/v3/users => generated 298 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:03.667148 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333959db-7919-4af1-91b3-6298d8d1e8b4 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.683421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333959db-7919-4af1-91b3-6298d8d1e8b4 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.690245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983435-8557-4928-be26-07259d2467dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.690932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983435-8557-4928-be26-07259d2467dc admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.691316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983435-8557-4928-be26-07259d2467dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.691609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a983435-8557-4928-be26-07259d2467dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.692563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a983435-8557-4928-be26-07259d2467dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.695770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 986/2002] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:03 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:03.695902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a983435-8557-4928-be26-07259d2467dc admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.700128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d761f-3a84-41c1-a224-f3e6f48ee1df admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.708512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1017/2003] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:03.711683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468d761f-3a84-41c1-a224-f3e6f48ee1df admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.712689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983435-8557-4928-be26-07259d2467dc admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.716863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a373e76-6c76-4a65-aac8-ced10c7ec351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.717675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373e76-6c76-4a65-aac8-ced10c7ec351 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.718532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373e76-6c76-4a65-aac8-ced10c7ec351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.718829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a373e76-6c76-4a65-aac8-ced10c7ec351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.720797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a373e76-6c76-4a65-aac8-ced10c7ec351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.723826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a373e76-6c76-4a65-aac8-ced10c7ec351 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.724213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a983435-8557-4928-be26-07259d2467dc admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.730559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d5e1-81e5-4d1e-9226-b8172553fd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.731493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d5e1-81e5-4d1e-9226-b8172553fd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.731927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d5e1-81e5-4d1e-9226-b8172553fd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.732334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e06d5e1-81e5-4d1e-9226-b8172553fd03 admin admin] PATH_INFO: `/v3/projects/97635421232448fe93d5acd5477fdd4d/users/986162d33809439da1527e9ecc62ec2b/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.736362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:03.736486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 987/2004] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:03.741493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a373e76-6c76-4a65-aac8-ced10c7ec351 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.752291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d5e1-81e5-4d1e-9226-b8172553fd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97635421232448fe93d5acd5477fdd4d, user_id=986162d33809439da1527e9ecc62ec2b, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.754139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a373e76-6c76-4a65-aac8-ced10c7ec351 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.755029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e06d5e1-81e5-4d1e-9226-b8172553fd03 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.758830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681079a8-3fda-4865-9fd3-848daec6a361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.759962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681079a8-3fda-4865-9fd3-848daec6a361 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.760333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681079a8-3fda-4865-9fd3-848daec6a361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.760908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681079a8-3fda-4865-9fd3-848daec6a361 admin admin] PATH_INFO: `/v3/projects/2cd8f0e7bc6042d186f8330a2193301a/users/42c1eee30d7a469ab5c17a36ea9a5728/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.770474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1018/2005] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:03 2022] PUT /identity/v3/projects/97635421232448fe93d5acd5477fdd4d/users/986162d33809439da1527e9ecc62ec2b/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:03.786713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d5e1-81e5-4d1e-9226-b8172553fd03 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.789400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681079a8-3fda-4865-9fd3-848daec6a361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd8f0e7bc6042d186f8330a2193301a, user_id=42c1eee30d7a469ab5c17a36ea9a5728, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.793267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681079a8-3fda-4865-9fd3-848daec6a361 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.819269 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 988/2006] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:03 2022] PUT /identity/v3/projects/2cd8f0e7bc6042d186f8330a2193301a/users/42c1eee30d7a469ab5c17a36ea9a5728/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:03.823102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681079a8-3fda-4865-9fd3-848daec6a361 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.920572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e06d5e1-81e5-4d1e-9226-b8172553fd03 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.960607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681079a8-3fda-4865-9fd3-848daec6a361 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:03.965945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e831cf-87df-4d19-bb91-9175fd29f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:03.966577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e831cf-87df-4d19-bb91-9175fd29f213 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:03.966867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e831cf-87df-4d19-bb91-9175fd29f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:03.967180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e831cf-87df-4d19-bb91-9175fd29f213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:03.967920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e831cf-87df-4d19-bb91-9175fd29f213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:03.970073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e831cf-87df-4d19-bb91-9175fd29f213 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:03.985923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 989/2007] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:03.987384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e831cf-87df-4d19-bb91-9175fd29f213 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:03.997697 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e831cf-87df-4d19-bb91-9175fd29f213 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:04.002775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943b237b-e8e4-4bba-9bb4-9c4573d7192a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:04.004112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b237b-e8e4-4bba-9bb4-9c4573d7192a admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.004400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b237b-e8e4-4bba-9bb4-9c4573d7192a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.004683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943b237b-e8e4-4bba-9bb4-9c4573d7192a admin admin] PATH_INFO: `/v3/projects/2cd8f0e7bc6042d186f8330a2193301a/users/42c1eee30d7a469ab5c17a36ea9a5728/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.006800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b237b-e8e4-4bba-9bb4-9c4573d7192a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd8f0e7bc6042d186f8330a2193301a, user_id=42c1eee30d7a469ab5c17a36ea9a5728, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:04.009712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943b237b-e8e4-4bba-9bb4-9c4573d7192a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:04.017682 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c30853-ccb7-4af1-8445-3c3bf3bbd1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:04.018517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c30853-ccb7-4af1-8445-3c3bf3bbd1b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.018798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c30853-ccb7-4af1-8445-3c3bf3bbd1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.019115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c30853-ccb7-4af1-8445-3c3bf3bbd1b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.019858 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c30853-ccb7-4af1-8445-3c3bf3bbd1b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:04.021511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c30853-ccb7-4af1-8445-3c3bf3bbd1b3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:04.024244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 990/2008] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:03 2022] PUT /identity/v3/projects/2cd8f0e7bc6042d186f8330a2193301a/users/42c1eee30d7a469ab5c17a36ea9a5728/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:04.034987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1019/2009] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:04.035206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fd127-3cab-4183-bba8-60ff2251734c None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.035346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fd127-3cab-4183-bba8-60ff2251734c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.035635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0fd127-3cab-4183-bba8-60ff2251734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.036373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c30853-ccb7-4af1-8445-3c3bf3bbd1b3 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:04.046258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c30853-ccb7-4af1-8445-3c3bf3bbd1b3 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:04.062538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-0f0fd127-3cab-4183-bba8-60ff2251734c None None] MFA Rules not processed for user `42c1eee30d7a469ab5c17a36ea9a5728`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:04.063886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0f0fd127-3cab-4183-bba8-60ff2251734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:04.073663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:04.105814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a267cd-2a20-4914-8150-31e013c4aae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:04.106737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a267cd-2a20-4914-8150-31e013c4aae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.107046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a267cd-2a20-4914-8150-31e013c4aae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.107324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a267cd-2a20-4914-8150-31e013c4aae3 admin admin] PATH_INFO: `/v3/projects/97635421232448fe93d5acd5477fdd4d/users/986162d33809439da1527e9ecc62ec2b/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.109621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a267cd-2a20-4914-8150-31e013c4aae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97635421232448fe93d5acd5477fdd4d, user_id=986162d33809439da1527e9ecc62ec2b, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:04.112964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a267cd-2a20-4914-8150-31e013c4aae3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:04.124046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1020/2010] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:04 2022] PUT /identity/v3/projects/97635421232448fe93d5acd5477fdd4d/users/986162d33809439da1527e9ecc62ec2b/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:04.135249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea9be7-0a35-45f7-afdc-b03d8e463d9f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.135550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea9be7-0a35-45f7-afdc-b03d8e463d9f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.135838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea9be7-0a35-45f7-afdc-b03d8e463d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.137526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 991/2011] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:04.148549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fd127-3cab-4183-bba8-60ff2251734c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:04.164371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a8ea9be7-0a35-45f7-afdc-b03d8e463d9f None None] MFA Rules not processed for user `986162d33809439da1527e9ecc62ec2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:04.165605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a8ea9be7-0a35-45f7-afdc-b03d8e463d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:04.176917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:04.222757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0fd127-3cab-4183-bba8-60ff2251734c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:04.261505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1021/2012] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:04 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:04.292471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf56351-31e0-4b0a-886a-ec751a6ee1c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:04.293656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf56351-31e0-4b0a-886a-ec751a6ee1c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.294700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf56351-31e0-4b0a-886a-ec751a6ee1c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.295352 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf56351-31e0-4b0a-886a-ec751a6ee1c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.308552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea9be7-0a35-45f7-afdc-b03d8e463d9f None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:04.310116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a8ea9be7-0a35-45f7-afdc-b03d8e463d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:04.327001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea9be7-0a35-45f7-afdc-b03d8e463d9f None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:04.331424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44837d90-9772-45dc-a986-8936eacdb016 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:04.332095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44837d90-9772-45dc-a986-8936eacdb016 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.332386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44837d90-9772-45dc-a986-8936eacdb016 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.332720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44837d90-9772-45dc-a986-8936eacdb016 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.344690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44837d90-9772-45dc-a986-8936eacdb016 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:04.347087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44837d90-9772-45dc-a986-8936eacdb016 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:04.362386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1022/2013] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:04 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:04.381178 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf56351-31e0-4b0a-886a-ec751a6ee1c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:04.383344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf56351-31e0-4b0a-886a-ec751a6ee1c0 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:04.395305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 992/2014] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:04.594248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44837d90-9772-45dc-a986-8936eacdb016 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:04.604343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44837d90-9772-45dc-a986-8936eacdb016 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:04.608413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f10474-e4f6-47bb-9e77-bfefc03f56f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:04.609060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f10474-e4f6-47bb-9e77-bfefc03f56f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:04.609400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f10474-e4f6-47bb-9e77-bfefc03f56f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:04.609669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f10474-e4f6-47bb-9e77-bfefc03f56f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:04.679555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f10474-e4f6-47bb-9e77-bfefc03f56f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:04.681280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f10474-e4f6-47bb-9e77-bfefc03f56f5 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:04.691622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1023/2015] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:06.296990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf56351-31e0-4b0a-886a-ec751a6ee1c0 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:06.306900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf56351-31e0-4b0a-886a-ec751a6ee1c0 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:06.311287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f3c00-a095-4b1f-9175-b7bf379804d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:06.312355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3c00-a095-4b1f-9175-b7bf379804d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:06.312642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3c00-a095-4b1f-9175-b7bf379804d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:06.313112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2f3c00-a095-4b1f-9175-b7bf379804d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:06.332445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:06.385415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f3c00-a095-4b1f-9175-b7bf379804d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:06.386940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2f3c00-a095-4b1f-9175-b7bf379804d4 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:06.398027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 993/2016] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:07.107815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f10474-e4f6-47bb-9e77-bfefc03f56f5 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:07.109633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-54f10474-e4f6-47bb-9e77-bfefc03f56f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:07.205507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f10474-e4f6-47bb-9e77-bfefc03f56f5 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.209700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.210753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.211258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.212068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] PATH_INFO: `/v3/users/cd1c97e7ceb0407d8947e51f1bfaa559` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.213632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1c97e7ceb0407d8947e51f1bfaa559)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.216236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.276201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:07.291616 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1c97e7ceb0407d8947e51f1bfaa559'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.292286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1c97e7ceb0407d8947e51f1bfaa559'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.292897 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1c97e7ceb0407d8947e51f1bfaa559'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.302893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1c97e7ceb0407d8947e51f1bfaa559'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.324199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a11b21a6-6495-46bb-a100-5d390a29bdf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1c97e7ceb0407d8947e51f1bfaa559'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:07.360653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f3c00-a095-4b1f-9175-b7bf379804d4 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:07.361160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1024/2017] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:07 2022] DELETE /identity/v3/users/cd1c97e7ceb0407d8947e51f1bfaa559 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:07.365118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ebef-42a1-46dc-8d24-9a82556fa728 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.365478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ebef-42a1-46dc-8d24-9a82556fa728 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.365821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f86ebef-42a1-46dc-8d24-9a82556fa728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.372318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2f3c00-a095-4b1f-9175-b7bf379804d4 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.387839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1f86ebef-42a1-46dc-8d24-9a82556fa728 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:07.390086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1f86ebef-42a1-46dc-8d24-9a82556fa728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:07.455573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf3db3-87da-4616-a1ff-9c4df17ce99f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.456492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf3db3-87da-4616-a1ff-9c4df17ce99f service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.456954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf3db3-87da-4616-a1ff-9c4df17ce99f service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.457377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cf3db3-87da-4616-a1ff-9c4df17ce99f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.466801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-65cf3db3-87da-4616-a1ff-9c4df17ce99f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:07.497348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1025/2018] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:07.562226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86ebef-42a1-46dc-8d24-9a82556fa728 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:07.564665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1f86ebef-42a1-46dc-8d24-9a82556fa728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:07.579517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf3db3-87da-4616-a1ff-9c4df17ce99f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.582302 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cf3db3-87da-4616-a1ff-9c4df17ce99f service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.597168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 994/2019] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:07.653116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f86ebef-42a1-46dc-8d24-9a82556fa728 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:07.659351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36566c54-7731-496b-a6a4-893ac5ebae67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:07.660005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36566c54-7731-496b-a6a4-893ac5ebae67 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:07.660294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36566c54-7731-496b-a6a4-893ac5ebae67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:07.660575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36566c54-7731-496b-a6a4-893ac5ebae67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:07.679233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36566c54-7731-496b-a6a4-893ac5ebae67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:07.679233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36566c54-7731-496b-a6a4-893ac5ebae67 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:07.687211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1026/2020] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:08.121108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf3db3-87da-4616-a1ff-9c4df17ce99f service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.123609 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-65cf3db3-87da-4616-a1ff-9c4df17ce99f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:08.174054 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cf3db3-87da-4616-a1ff-9c4df17ce99f service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.188288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.190888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.192856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.193255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] PATH_INFO: `/v3/users/3bf43c3dfcdf43f8893dc14b06b273df` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.197567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bf43c3dfcdf43f8893dc14b06b273df)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.198754 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.229842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36566c54-7731-496b-a6a4-893ac5ebae67 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.232013 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-36566c54-7731-496b-a6a4-893ac5ebae67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:08.254886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36566c54-7731-496b-a6a4-893ac5ebae67 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.271483 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.272641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.273080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.273512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] PATH_INFO: `/v3/projects/7da764d7d6df48508153ffd0007f9bb1` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.275155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da764d7d6df48508153ffd0007f9bb1)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.277482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.324436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bf43c3dfcdf43f8893dc14b06b273df'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.325694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bf43c3dfcdf43f8893dc14b06b273df'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.326407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bf43c3dfcdf43f8893dc14b06b273df'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.338976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bf43c3dfcdf43f8893dc14b06b273df'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.343719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:08.353572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e82fdf8d-b5c8-40df-b278-55e63c13abd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bf43c3dfcdf43f8893dc14b06b273df'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.377798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da764d7d6df48508153ffd0007f9bb1', 'request_id': 'req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.380197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:08.392716 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 995/2021] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:08 2022] DELETE /identity/v3/users/3bf43c3dfcdf43f8893dc14b06b273df => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:08.394323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21377392-9e29-41a7-a897-19513aae5103 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.394652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21377392-9e29-41a7-a897-19513aae5103 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.394942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21377392-9e29-41a7-a897-19513aae5103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.397514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da764d7d6df48508153ffd0007f9bb1', 'request_id': 'req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.409103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da764d7d6df48508153ffd0007f9bb1', 'request_id': 'req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.430638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] The token cache is being invalidate because project 7da764d7d6df48508153ffd0007f9bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:08.430940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.431892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.441507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1027/2022] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:08 2022] DELETE /identity/v3/projects/7da764d7d6df48508153ffd0007f9bb1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:08.442504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-21377392-9e29-41a7-a897-19513aae5103 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:08.443917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-21377392-9e29-41a7-a897-19513aae5103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:08.444387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.447436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:08.575808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a1d7e1-f1c5-4a44-bd00-2f988382e9f5 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.583422 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 996/2023] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:08.584893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.586038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.586386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.586794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] PATH_INFO: `/v3/users/9a98d4a0a4df49faba0901754d951515` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.588385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a98d4a0a4df49faba0901754d951515)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.591588 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.594285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21377392-9e29-41a7-a897-19513aae5103 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.597562 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-21377392-9e29-41a7-a897-19513aae5103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:08.698483 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a98d4a0a4df49faba0901754d951515'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.699415 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a98d4a0a4df49faba0901754d951515'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.700764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a98d4a0a4df49faba0901754d951515'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.711822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21377392-9e29-41a7-a897-19513aae5103 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.717763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c9f84-c24f-4901-8b89-fb255e13c831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.718915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c9f84-c24f-4901-8b89-fb255e13c831 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.720528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c9f84-c24f-4901-8b89-fb255e13c831 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.720675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a98d4a0a4df49faba0901754d951515'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.732615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c9f84-c24f-4901-8b89-fb255e13c831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.736537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-378c9f84-c24f-4901-8b89-fb255e13c831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:08.741050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-2295ee3f-edb6-4bee-a8bf-45b93595db43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a98d4a0a4df49faba0901754d951515'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.753469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c9f84-c24f-4901-8b89-fb255e13c831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.755151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c9f84-c24f-4901-8b89-fb255e13c831 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.770666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 997/2024] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:08.771919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c9f84-c24f-4901-8b89-fb255e13c831 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:08.773749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-378c9f84-c24f-4901-8b89-fb255e13c831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:08.775254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1028/2025] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:08 2022] DELETE /identity/v3/users/9a98d4a0a4df49faba0901754d951515 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:08.787606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c9f84-c24f-4901-8b89-fb255e13c831 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:08.896368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:08.897283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:08.897780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:08.897982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] PATH_INFO: `/v3/users/53b28d6e10644cb299db6cff8c8828ea` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:08.899401 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53b28d6e10644cb299db6cff8c8828ea)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:08.902434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:08.929445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:08.970292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53b28d6e10644cb299db6cff8c8828ea'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.971093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53b28d6e10644cb299db6cff8c8828ea'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.971760 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53b28d6e10644cb299db6cff8c8828ea'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.980548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53b28d6e10644cb299db6cff8c8828ea'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:08.989065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53b28d6e10644cb299db6cff8c8828ea'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.020502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 998/2026] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:08 2022] DELETE /identity/v3/users/53b28d6e10644cb299db6cff8c8828ea => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:09.025774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c0820-0074-4b14-b509-49b99baaf490 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.026263 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c0820-0074-4b14-b509-49b99baaf490 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.026674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780c0820-0074-4b14-b509-49b99baaf490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.050393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-780c0820-0074-4b14-b509-49b99baaf490 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:09.052018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-780c0820-0074-4b14-b509-49b99baaf490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.130601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:09.151386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1029/2027] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:09.168348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:09.170247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.268553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0010fb28-d0f6-474c-b5db-d9723daf21e2 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.274433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc122c-4ce4-49af-b7fb-638796a54981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.275440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc122c-4ce4-49af-b7fb-638796a54981 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.275639 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc122c-4ce4-49af-b7fb-638796a54981 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.277534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc122c-4ce4-49af-b7fb-638796a54981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.290063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc122c-4ce4-49af-b7fb-638796a54981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.291591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dc122c-4ce4-49af-b7fb-638796a54981 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:09.303784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 999/2028] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:09.606364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c0820-0074-4b14-b509-49b99baaf490 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:09.607892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-780c0820-0074-4b14-b509-49b99baaf490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.621126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780c0820-0074-4b14-b509-49b99baaf490 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.624510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc122c-4ce4-49af-b7fb-638796a54981 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:09.625989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-43dc122c-4ce4-49af-b7fb-638796a54981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.626755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.628315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.628673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.629017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] PATH_INFO: `/v3/projects/19b440b3053e494884e521064cf5ea54` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.630407 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b440b3053e494884e521064cf5ea54)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.632862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:09.640674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dc122c-4ce4-49af-b7fb-638796a54981 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.646378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.647298 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.647587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.647939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] PATH_INFO: `/v3/projects/b5ac29f974c9485c9434441d299af935` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.649146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5ac29f974c9485c9434441d299af935)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.651763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:09.690323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b440b3053e494884e521064cf5ea54', 'request_id': 'req-04a177f4-7754-4c67-abe1-5ad6037ca585'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.704186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b440b3053e494884e521064cf5ea54', 'request_id': 'req-04a177f4-7754-4c67-abe1-5ad6037ca585'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.708519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5ac29f974c9485c9434441d299af935', 'request_id': 'req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.712897 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b440b3053e494884e521064cf5ea54', 'request_id': 'req-04a177f4-7754-4c67-abe1-5ad6037ca585'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.718124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5ac29f974c9485c9434441d299af935', 'request_id': 'req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.726130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5ac29f974c9485c9434441d299af935', 'request_id': 'req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.727389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] The token cache is being invalidate because project 19b440b3053e494884e521064cf5ea54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:09.728622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.729822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-04a177f4-7754-4c67-abe1-5ad6037ca585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.735854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1030/2029] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:09 2022] DELETE /identity/v3/projects/19b440b3053e494884e521064cf5ea54 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:09.737980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c3e7e-707a-4d92-bfb2-6e6b92916f88 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.738345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c3e7e-707a-4d92-bfb2-6e6b92916f88 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.738801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956c3e7e-707a-4d92-bfb2-6e6b92916f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.739992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] The token cache is being invalidate because project b5ac29f974c9485c9434441d299af935 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:09.740767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.741452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.746928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1000/2030] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:09 2022] DELETE /identity/v3/projects/b5ac29f974c9485c9434441d299af935 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:09.747490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:09.749176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.764810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-956c3e7e-707a-4d92-bfb2-6e6b92916f88 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:09.766699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-956c3e7e-707a-4d92-bfb2-6e6b92916f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.807864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:09.850529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f53b2b-8916-4e32-92a0-38fa5796c5c3 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.858298 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.859469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.860581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.861057 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] PATH_INFO: `/v3/users/789c2aafed144716b0b84ffa370fb05b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.863030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789c2aafed144716b0b84ffa370fb05b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.866724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:09.878030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1031/2031] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:09.885764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ed40-36e4-4629-96f2-7aba517afed9 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.886147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ed40-36e4-4629-96f2-7aba517afed9 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.886495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491ed40-36e4-4629-96f2-7aba517afed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.909830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a491ed40-36e4-4629-96f2-7aba517afed9 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:09.911482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a491ed40-36e4-4629-96f2-7aba517afed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.921857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1032/2032] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:09.927435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ed40-36e4-4629-96f2-7aba517afed9 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:09.938741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491ed40-36e4-4629-96f2-7aba517afed9 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.944875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46b12a-5b54-4fc0-a690-5504af65cbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.945653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b12a-5b54-4fc0-a690-5504af65cbbe admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.945959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b12a-5b54-4fc0-a690-5504af65cbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.946270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca46b12a-5b54-4fc0-a690-5504af65cbbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.947143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46b12a-5b54-4fc0-a690-5504af65cbbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:09.948133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46b12a-5b54-4fc0-a690-5504af65cbbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.949864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca46b12a-5b54-4fc0-a690-5504af65cbbe admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:09.956245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789c2aafed144716b0b84ffa370fb05b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.957218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789c2aafed144716b0b84ffa370fb05b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.958219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789c2aafed144716b0b84ffa370fb05b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.963656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1033/2033] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:09.967122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789c2aafed144716b0b84ffa370fb05b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.967952 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46b12a-5b54-4fc0-a690-5504af65cbbe admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:09.970286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ca46b12a-5b54-4fc0-a690-5504af65cbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:09.980126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789c2aafed144716b0b84ffa370fb05b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:09.985365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca46b12a-5b54-4fc0-a690-5504af65cbbe admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:09.990200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05780f-9f13-433a-9cda-c66b95123b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:09.991072 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05780f-9f13-433a-9cda-c66b95123b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:09.991464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05780f-9f13-433a-9cda-c66b95123b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:09.991817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05780f-9f13-433a-9cda-c66b95123b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:09.992636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05780f-9f13-433a-9cda-c66b95123b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:09.994815 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05780f-9f13-433a-9cda-c66b95123b3e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:10.005569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1001/2034] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:09 2022] DELETE /identity/v3/users/789c2aafed144716b0b84ffa370fb05b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:10.038587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1034/2035] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:09 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:10.041883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:10.148047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e5e0d-1993-4bf8-bbb9-575900efe401 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:10.229227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:10.247955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c627d-e641-47d2-b0de-6e64bf8dde2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:10.248863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c627d-e641-47d2-b0de-6e64bf8dde2f admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:10.249164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c627d-e641-47d2-b0de-6e64bf8dde2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:10.249683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c627d-e641-47d2-b0de-6e64bf8dde2f admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:10.251052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c627d-e641-47d2-b0de-6e64bf8dde2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:10.255567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c627d-e641-47d2-b0de-6e64bf8dde2f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:10.283976 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1002/2036] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:10 2022] POST /identity/v3/users => generated 288 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:10.288753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05780f-9f13-433a-9cda-c66b95123b3e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:10.306132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05780f-9f13-433a-9cda-c66b95123b3e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:10.316071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a4849-8908-4218-a018-37896978b619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:10.317089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a4849-8908-4218-a018-37896978b619 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:10.317544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a4849-8908-4218-a018-37896978b619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:10.317923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67a4849-8908-4218-a018-37896978b619 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:10.321276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a4849-8908-4218-a018-37896978b619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:10.323641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67a4849-8908-4218-a018-37896978b619 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:10.347888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1035/2037] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:10.349280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c627d-e641-47d2-b0de-6e64bf8dde2f admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:10.367879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c627d-e641-47d2-b0de-6e64bf8dde2f admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:10.377365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5028e66a-26b5-4b43-b264-a180a13d3e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:10.377365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028e66a-26b5-4b43-b264-a180a13d3e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:10.377365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028e66a-26b5-4b43-b264-a180a13d3e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:10.377365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5028e66a-26b5-4b43-b264-a180a13d3e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:10.378704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028e66a-26b5-4b43-b264-a180a13d3e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:10.380684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5028e66a-26b5-4b43-b264-a180a13d3e47 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:10.404898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1003/2038] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:10.408240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a4849-8908-4218-a018-37896978b619 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:10.424921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67a4849-8908-4218-a018-37896978b619 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:10.431675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d2c47-2f52-4842-bc3d-fb07980d295f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:10.432838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2c47-2f52-4842-bc3d-fb07980d295f admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:10.433149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2c47-2f52-4842-bc3d-fb07980d295f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:10.433582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d2c47-2f52-4842-bc3d-fb07980d295f admin admin] PATH_INFO: `/v3/projects/56ea29f8e3b34d95857311e10d43e477/users/0f6648643cf44b8c96a07acfa9714aae/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:10.458537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d2c47-2f52-4842-bc3d-fb07980d295f admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ea29f8e3b34d95857311e10d43e477, user_id=0f6648643cf44b8c96a07acfa9714aae, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:10.462023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d2c47-2f52-4842-bc3d-fb07980d295f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:10.521972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1036/2039] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:10 2022] PUT /identity/v3/projects/56ea29f8e3b34d95857311e10d43e477/users/0f6648643cf44b8c96a07acfa9714aae/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:10.530741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de703-4f5b-4b81-80e1-64f722f479d6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:10.532479 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de703-4f5b-4b81-80e1-64f722f479d6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:10.532918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de703-4f5b-4b81-80e1-64f722f479d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:10.612963 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-0a4de703-4f5b-4b81-80e1-64f722f479d6 None None] MFA Rules not processed for user `0f6648643cf44b8c96a07acfa9714aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:10.615926 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d2c47-2f52-4842-bc3d-fb07980d295f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:10.617772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0a4de703-4f5b-4b81-80e1-64f722f479d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:10.620160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e26d2c47-2f52-4842-bc3d-fb07980d295f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:10.626702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:10.753201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d2c47-2f52-4842-bc3d-fb07980d295f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:10.761824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:10.763314 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:10.763870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:10.764684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] PATH_INFO: `/v3/projects/6add11c8c9164ce29cbe10929cf1742c` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:10.766385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6add11c8c9164ce29cbe10929cf1742c)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:10.769520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:10.801742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1004/2040] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:10.803419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de703-4f5b-4b81-80e1-64f722f479d6 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:10.805169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0a4de703-4f5b-4b81-80e1-64f722f479d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:10.821095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de703-4f5b-4b81-80e1-64f722f479d6 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:10.836854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6add11c8c9164ce29cbe10929cf1742c', 'request_id': 'req-87774b2f-71ab-4cda-be70-903c3fc80f1b'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:10.846741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6add11c8c9164ce29cbe10929cf1742c', 'request_id': 'req-87774b2f-71ab-4cda-be70-903c3fc80f1b'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:10.853702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6add11c8c9164ce29cbe10929cf1742c', 'request_id': 'req-87774b2f-71ab-4cda-be70-903c3fc80f1b'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:10.869382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] The token cache is being invalidate because project 6add11c8c9164ce29cbe10929cf1742c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:10.869758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:10.870520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:10.875207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1037/2041] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:10 2022] DELETE /identity/v3/projects/6add11c8c9164ce29cbe10929cf1742c => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:10.875207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:10.876885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:10.900886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:10.901954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:10.902356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:10.902648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] PATH_INFO: `/v3/projects/9354703026ee4954b7a38cbb981b361f` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:10.903985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9354703026ee4954b7a38cbb981b361f)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:10.905917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.001008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9354703026ee4954b7a38cbb981b361f', 'request_id': 'req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.012084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87774b2f-71ab-4cda-be70-903c3fc80f1b admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.015147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9354703026ee4954b7a38cbb981b361f', 'request_id': 'req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.021294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:11.022818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9354703026ee4954b7a38cbb981b361f', 'request_id': 'req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.042726 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] The token cache is being invalidate because project 9354703026ee4954b7a38cbb981b361f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:11.043184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.044039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.045559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1005/2042] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:10 2022] DELETE /identity/v3/projects/9354703026ee4954b7a38cbb981b361f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:11.052350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.054337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:11.121130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:11.151086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ed9a61-a119-47a2-a38a-ab312b9e5f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.151628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9a61-a119-47a2-a38a-ab312b9e5f0a admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.151914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9a61-a119-47a2-a38a-ab312b9e5f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.152187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ed9a61-a119-47a2-a38a-ab312b9e5f0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.152868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed9a61-a119-47a2-a38a-ab312b9e5f0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.154779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ed9a61-a119-47a2-a38a-ab312b9e5f0a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.161468 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f20094b-dc09-4ce9-8316-0d9b8a374f2b admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.166112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.167010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.167295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.167571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] PATH_INFO: `/v3/users/986162d33809439da1527e9ecc62ec2b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.168872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=986162d33809439da1527e9ecc62ec2b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.171097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.183051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1038/2043] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:10 2022] POST /identity/v3/projects => generated 379 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:11.183051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207e988-a0bd-44f5-aa30-1b0b191f9749 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.183051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207e988-a0bd-44f5-aa30-1b0b191f9749 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.183051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9207e988-a0bd-44f5-aa30-1b0b191f9749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.203929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-9207e988-a0bd-44f5-aa30-1b0b191f9749 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:11.205733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9207e988-a0bd-44f5-aa30-1b0b191f9749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:11.249575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '986162d33809439da1527e9ecc62ec2b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.250275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '986162d33809439da1527e9ecc62ec2b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.255717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '986162d33809439da1527e9ecc62ec2b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.269374 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '986162d33809439da1527e9ecc62ec2b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.275343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1039/2044] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:11.276193 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207e988-a0bd-44f5-aa30-1b0b191f9749 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.277663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9207e988-a0bd-44f5-aa30-1b0b191f9749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:11.290597 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0c558051-c202-41fd-beac-9089a2bc5a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '986162d33809439da1527e9ecc62ec2b'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.291941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9207e988-a0bd-44f5-aa30-1b0b191f9749 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.297804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f0ce8-8fee-4a93-9fc8-57d2e29631e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.298580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f0ce8-8fee-4a93-9fc8-57d2e29631e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.299084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f0ce8-8fee-4a93-9fc8-57d2e29631e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.299539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f0ce8-8fee-4a93-9fc8-57d2e29631e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.300493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f0ce8-8fee-4a93-9fc8-57d2e29631e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.302578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f0ce8-8fee-4a93-9fc8-57d2e29631e3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.309561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1006/2045] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:11 2022] DELETE /identity/v3/users/986162d33809439da1527e9ecc62ec2b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:11.312591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103652-d90f-444f-87a1-bdcd011bb56f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.312889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103652-d90f-444f-87a1-bdcd011bb56f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.313204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b103652-d90f-444f-87a1-bdcd011bb56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.329734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1040/2046] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:11 2022] POST /identity/v3/users => generated 296 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:11.331288 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f0ce8-8fee-4a93-9fc8-57d2e29631e3 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.334198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-4b103652-d90f-444f-87a1-bdcd011bb56f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:11.335465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4b103652-d90f-444f-87a1-bdcd011bb56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:11.342164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f0ce8-8fee-4a93-9fc8-57d2e29631e3 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.410474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1007/2047] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:11.414780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b103652-d90f-444f-87a1-bdcd011bb56f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.415620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6a81d-9d17-4227-ab7c-35e6be85217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.416366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6a81d-9d17-4227-ab7c-35e6be85217c admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.416715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6a81d-9d17-4227-ab7c-35e6be85217c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.417485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c6a81d-9d17-4227-ab7c-35e6be85217c admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.418428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6a81d-9d17-4227-ab7c-35e6be85217c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.420949 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c6a81d-9d17-4227-ab7c-35e6be85217c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.426345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b103652-d90f-444f-87a1-bdcd011bb56f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.433382 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79432bd4-1643-488d-b024-da69d80a0c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.434241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79432bd4-1643-488d-b024-da69d80a0c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.434533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79432bd4-1643-488d-b024-da69d80a0c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.434859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79432bd4-1643-488d-b024-da69d80a0c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.435669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79432bd4-1643-488d-b024-da69d80a0c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:11.435987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79432bd4-1643-488d-b024-da69d80a0c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.438520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1041/2048] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:11.438661 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79432bd4-1643-488d-b024-da69d80a0c50 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.443290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6a81d-9d17-4227-ab7c-35e6be85217c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.446434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:11.458435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1008/2049] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:11.459434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79432bd4-1643-488d-b024-da69d80a0c50 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.461564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c6a81d-9d17-4227-ab7c-35e6be85217c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.467323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84848a7-f08b-4f7e-a406-0eddf73323c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.468745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84848a7-f08b-4f7e-a406-0eddf73323c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.470081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84848a7-f08b-4f7e-a406-0eddf73323c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.470506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79432bd4-1643-488d-b024-da69d80a0c50 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.470795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84848a7-f08b-4f7e-a406-0eddf73323c3 admin admin] PATH_INFO: `/v3/projects/0f10bc15fd3041a788a23b7e044ba912/users/f49b048781c34a448233722e6eef9d9a/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.477771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac8736-7529-40e2-9f26-e671359d9a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.478604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac8736-7529-40e2-9f26-e671359d9a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.478895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac8736-7529-40e2-9f26-e671359d9a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.479226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ac8736-7529-40e2-9f26-e671359d9a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.479929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac8736-7529-40e2-9f26-e671359d9a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.481927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ac8736-7529-40e2-9f26-e671359d9a4d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.522402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1009/2050] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:11 2022] POST /identity/v3/projects => generated 409 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:11.526390 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac8736-7529-40e2-9f26-e671359d9a4d admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.536994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84848a7-f08b-4f7e-a406-0eddf73323c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f10bc15fd3041a788a23b7e044ba912, user_id=f49b048781c34a448233722e6eef9d9a, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.540582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84848a7-f08b-4f7e-a406-0eddf73323c3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.572586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1042/2051] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:11 2022] PUT /identity/v3/projects/0f10bc15fd3041a788a23b7e044ba912/users/f49b048781c34a448233722e6eef9d9a/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:11.574306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84848a7-f08b-4f7e-a406-0eddf73323c3 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.619307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ac8736-7529-40e2-9f26-e671359d9a4d admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.629677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:11.676000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84848a7-f08b-4f7e-a406-0eddf73323c3 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.681294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849a610-b167-4eab-b003-4d3866afd858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.681997 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849a610-b167-4eab-b003-4d3866afd858 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.682280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849a610-b167-4eab-b003-4d3866afd858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.682831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a849a610-b167-4eab-b003-4d3866afd858 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.683650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849a610-b167-4eab-b003-4d3866afd858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.685588 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a849a610-b167-4eab-b003-4d3866afd858 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.703795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1043/2052] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:11.704987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849a610-b167-4eab-b003-4d3866afd858 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.706739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a849a610-b167-4eab-b003-4d3866afd858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:11.712168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19fc30-db4d-4cc3-82ee-8edc787e5523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.713697 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19fc30-db4d-4cc3-82ee-8edc787e5523 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.714659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19fc30-db4d-4cc3-82ee-8edc787e5523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.715398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19fc30-db4d-4cc3-82ee-8edc787e5523 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.716595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19fc30-db4d-4cc3-82ee-8edc787e5523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.718607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf19fc30-db4d-4cc3-82ee-8edc787e5523 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.721218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a849a610-b167-4eab-b003-4d3866afd858 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.726806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.727731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.728019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.728299 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] PATH_INFO: `/v3/projects/97635421232448fe93d5acd5477fdd4d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.730128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] RBAC: Authorizing `identity:delete_project(project_id=97635421232448fe93d5acd5477fdd4d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.735535 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.753332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1010/2053] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:11 2022] POST /identity/v3/users => generated 305 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:11.754150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19fc30-db4d-4cc3-82ee-8edc787e5523 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.765158 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf19fc30-db4d-4cc3-82ee-8edc787e5523 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.770541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239982a-bf05-4860-b5b9-2995530b6476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.771494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239982a-bf05-4860-b5b9-2995530b6476 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.771830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239982a-bf05-4860-b5b9-2995530b6476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.772114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5239982a-bf05-4860-b5b9-2995530b6476 admin admin] PATH_INFO: `/v3/projects/0f10bc15fd3041a788a23b7e044ba912/users/f49b048781c34a448233722e6eef9d9a/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.774261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239982a-bf05-4860-b5b9-2995530b6476 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f10bc15fd3041a788a23b7e044ba912, user_id=f49b048781c34a448233722e6eef9d9a, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.777126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5239982a-bf05-4860-b5b9-2995530b6476 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.805263 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97635421232448fe93d5acd5477fdd4d', 'request_id': 'req-eb891eb9-d876-46d2-912b-d0de74a8bfef'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.806211 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1011/2054] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:11 2022] PUT /identity/v3/projects/0f10bc15fd3041a788a23b7e044ba912/users/f49b048781c34a448233722e6eef9d9a/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:11.807388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239982a-bf05-4860-b5b9-2995530b6476 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.831789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97635421232448fe93d5acd5477fdd4d', 'request_id': 'req-eb891eb9-d876-46d2-912b-d0de74a8bfef'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.841372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97635421232448fe93d5acd5477fdd4d', 'request_id': 'req-eb891eb9-d876-46d2-912b-d0de74a8bfef'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.863302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] The token cache is being invalidate because project 97635421232448fe93d5acd5477fdd4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:11.863630 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.864498 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-eb891eb9-d876-46d2-912b-d0de74a8bfef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:11.869567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1044/2055] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:11 2022] DELETE /identity/v3/projects/97635421232448fe93d5acd5477fdd4d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:11.871057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b04e-3931-429a-83f9-79c04a371d3b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.871354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b04e-3931-429a-83f9-79c04a371d3b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.871614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821b04e-3931-429a-83f9-79c04a371d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.899721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5239982a-bf05-4860-b5b9-2995530b6476 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.902804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d821b04e-3931-429a-83f9-79c04a371d3b None None] MFA Rules not processed for user `f49b048781c34a448233722e6eef9d9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:11.904059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d821b04e-3931-429a-83f9-79c04a371d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:11.904959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57305375-1bce-4317-b729-8e44cad15259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.905811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305375-1bce-4317-b729-8e44cad15259 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.906146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305375-1bce-4317-b729-8e44cad15259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.906606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57305375-1bce-4317-b729-8e44cad15259 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.907704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57305375-1bce-4317-b729-8e44cad15259 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.909465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57305375-1bce-4317-b729-8e44cad15259 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:11.911190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:11.926410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1012/2056] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:11.928095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f166de-dbc4-4307-899a-5ac87c768636 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.928476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f166de-dbc4-4307-899a-5ac87c768636 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.928920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f166de-dbc4-4307-899a-5ac87c768636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.956859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-f3f166de-dbc4-4307-899a-5ac87c768636 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:11.958493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f3f166de-dbc4-4307-899a-5ac87c768636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:11.970407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1013/2057] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:11.977053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f166de-dbc4-4307-899a-5ac87c768636 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.977053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f3f166de-dbc4-4307-899a-5ac87c768636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:11.985877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f166de-dbc4-4307-899a-5ac87c768636 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:11.991913 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:11.992806 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:11.993126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:11.993859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1045/2058] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:11.994053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] PATH_INFO: `/v3/users/d9657672b0424549b3b7dc31cd5c26d7` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:11.994541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821b04e-3931-429a-83f9-79c04a371d3b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:11.995423 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9657672b0424549b3b7dc31cd5c26d7)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:11.995898 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d821b04e-3931-429a-83f9-79c04a371d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:11.997841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.014793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821b04e-3931-429a-83f9-79c04a371d3b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.019772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd60213-02bf-40a2-b03c-c05133798c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.020438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60213-02bf-40a2-b03c-c05133798c28 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.020716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60213-02bf-40a2-b03c-c05133798c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.021191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd60213-02bf-40a2-b03c-c05133798c28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.021910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd60213-02bf-40a2-b03c-c05133798c28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.023570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd60213-02bf-40a2-b03c-c05133798c28 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.034794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1046/2059] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:12.035887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4c08-2bc6-461a-b50a-43d8012048ef None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.036171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4c08-2bc6-461a-b50a-43d8012048ef None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.036450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d4c08-2bc6-461a-b50a-43d8012048ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.056125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1c4d4c08-2bc6-461a-b50a-43d8012048ef None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:12.057927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1c4d4c08-2bc6-461a-b50a-43d8012048ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:12.058936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9657672b0424549b3b7dc31cd5c26d7'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:12.059810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9657672b0424549b3b7dc31cd5c26d7'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:12.060474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9657672b0424549b3b7dc31cd5c26d7'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:12.067273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1047/2060] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:12.068350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4c08-2bc6-461a-b50a-43d8012048ef None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.072191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1c4d4c08-2bc6-461a-b50a-43d8012048ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:12.072971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9657672b0424549b3b7dc31cd5c26d7'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:12.081854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9657672b0424549b3b7dc31cd5c26d7'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:12.084580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:12.106769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1014/2061] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:11 2022] DELETE /identity/v3/users/d9657672b0424549b3b7dc31cd5c26d7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:12.108204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.110946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:12.143608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d4c08-2bc6-461a-b50a-43d8012048ef None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.213121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bed1e82-304c-4e03-83a4-a9f9d18a878a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.213322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d188039-28eb-412a-a93d-260806847ddf admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.213989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed1e82-304c-4e03-83a4-a9f9d18a878a service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.214463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed1e82-304c-4e03-83a4-a9f9d18a878a service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.214752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bed1e82-304c-4e03-83a4-a9f9d18a878a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.216577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9bed1e82-304c-4e03-83a4-a9f9d18a878a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:12.218698 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434faf-8fab-4811-8c60-6d5cd788c989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.220691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434faf-8fab-4811-8c60-6d5cd788c989 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.220992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434faf-8fab-4811-8c60-6d5cd788c989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.221271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50434faf-8fab-4811-8c60-6d5cd788c989 admin admin] PATH_INFO: `/v3/projects/ba58266901714c17b346905c3889d0d9/users/cbe4377c00074301994a7ed8f60e313a/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.244304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50434faf-8fab-4811-8c60-6d5cd788c989 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba58266901714c17b346905c3889d0d9, user_id=cbe4377c00074301994a7ed8f60e313a, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.248553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50434faf-8fab-4811-8c60-6d5cd788c989 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.278173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1015/2062] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:12 2022] PUT /identity/v3/projects/ba58266901714c17b346905c3889d0d9/users/cbe4377c00074301994a7ed8f60e313a/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:12.288684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434faf-8fab-4811-8c60-6d5cd788c989 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.294372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed1e82-304c-4e03-83a4-a9f9d18a878a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.295976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bed1e82-304c-4e03-83a4-a9f9d18a878a service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.305677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1048/2063] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:12.312940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab4b29-0269-41c7-8473-93d49413712d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.313440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab4b29-0269-41c7-8473-93d49413712d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.313845 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab4b29-0269-41c7-8473-93d49413712d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.333201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c9ab4b29-0269-41c7-8473-93d49413712d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:12.334629 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c9ab4b29-0269-41c7-8473-93d49413712d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:12.340239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:12.364518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50434faf-8fab-4811-8c60-6d5cd788c989 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.369662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d536e-7c13-47fb-bfb4-c7f0c180d7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.370393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d536e-7c13-47fb-bfb4-c7f0c180d7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.370780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d536e-7c13-47fb-bfb4-c7f0c180d7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.371199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d536e-7c13-47fb-bfb4-c7f0c180d7c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.372058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d536e-7c13-47fb-bfb4-c7f0c180d7c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:12.372368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d536e-7c13-47fb-bfb4-c7f0c180d7c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.374063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653d536e-7c13-47fb-bfb4-c7f0c180d7c3 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.386617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1016/2064] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:12.387305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dea32e-23be-41dd-877a-4028e3689a6b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.387603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dea32e-23be-41dd-877a-4028e3689a6b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.387870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dea32e-23be-41dd-877a-4028e3689a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.418074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1049/2065] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:12.420295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab4b29-0269-41c7-8473-93d49413712d None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.420445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-b6dea32e-23be-41dd-877a-4028e3689a6b None None] MFA Rules not processed for user `cbe4377c00074301994a7ed8f60e313a`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:12.428749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b6dea32e-23be-41dd-877a-4028e3689a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:12.431051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab4b29-0269-41c7-8473-93d49413712d None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.436101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c1b6f-4bb8-480c-aef5-16639f579529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.437025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c1b6f-4bb8-480c-aef5-16639f579529 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.437723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c1b6f-4bb8-480c-aef5-16639f579529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.438011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c1b6f-4bb8-480c-aef5-16639f579529 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.438823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c1b6f-4bb8-480c-aef5-16639f579529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.441555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c1b6f-4bb8-480c-aef5-16639f579529 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.463986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:12.479405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1050/2066] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:12 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:12.479405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c1b6f-4bb8-480c-aef5-16639f579529 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.481502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ab7c1b6f-4bb8-480c-aef5-16639f579529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:12.537295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1017/2067] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:12.541465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dea32e-23be-41dd-877a-4028e3689a6b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.555400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dea32e-23be-41dd-877a-4028e3689a6b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.579004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c1b6f-4bb8-480c-aef5-16639f579529 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.592446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f6307-053e-4555-8e8d-6ce7c56ad979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.593597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f6307-053e-4555-8e8d-6ce7c56ad979 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.594561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f6307-053e-4555-8e8d-6ce7c56ad979 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.595101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f6307-053e-4555-8e8d-6ce7c56ad979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.625868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe880de-ffcf-4ca7-b6d8-891caa64be1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.626807 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe880de-ffcf-4ca7-b6d8-891caa64be1a admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.627463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe880de-ffcf-4ca7-b6d8-891caa64be1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.627938 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe880de-ffcf-4ca7-b6d8-891caa64be1a admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.629202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe880de-ffcf-4ca7-b6d8-891caa64be1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.631432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe880de-ffcf-4ca7-b6d8-891caa64be1a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.661422 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1018/2068] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:12 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:12.664048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe880de-ffcf-4ca7-b6d8-891caa64be1a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.681721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe880de-ffcf-4ca7-b6d8-891caa64be1a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.688667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb99ec-1523-4875-9c42-ab6b64003bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.689503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb99ec-1523-4875-9c42-ab6b64003bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.689888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb99ec-1523-4875-9c42-ab6b64003bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.690894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb99ec-1523-4875-9c42-ab6b64003bb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.691808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb99ec-1523-4875-9c42-ab6b64003bb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.694205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb99ec-1523-4875-9c42-ab6b64003bb9 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.716368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f6307-053e-4555-8e8d-6ce7c56ad979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.720272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f6307-053e-4555-8e8d-6ce7c56ad979 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.731206 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1051/2069] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:12.732174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f6307-053e-4555-8e8d-6ce7c56ad979 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.754296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f6307-053e-4555-8e8d-6ce7c56ad979 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.756006 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1019/2070] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:12 2022] POST /identity/v3/projects => generated 409 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:12.761882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb99ec-1523-4875-9c42-ab6b64003bb9 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.831268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:12.839522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793d067-e30d-463a-aaff-c4b79ed695f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.840307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d067-e30d-463a-aaff-c4b79ed695f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.840623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d067-e30d-463a-aaff-c4b79ed695f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.840914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d067-e30d-463a-aaff-c4b79ed695f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.841900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793d067-e30d-463a-aaff-c4b79ed695f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.844476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793d067-e30d-463a-aaff-c4b79ed695f0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.857738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1052/2071] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:12.862307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793d067-e30d-463a-aaff-c4b79ed695f0 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.865002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb99ec-1523-4875-9c42-ab6b64003bb9 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.870365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f682ee5-5416-4aef-bf9d-50a0f5f52abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.871144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f682ee5-5416-4aef-bf9d-50a0f5f52abf admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.871491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f682ee5-5416-4aef-bf9d-50a0f5f52abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.871894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f682ee5-5416-4aef-bf9d-50a0f5f52abf admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.872679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f682ee5-5416-4aef-bf9d-50a0f5f52abf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.873138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793d067-e30d-463a-aaff-c4b79ed695f0 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.875132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f682ee5-5416-4aef-bf9d-50a0f5f52abf admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.885341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606eb84-44fa-4aea-9ef8-2ea6694f70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.886299 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606eb84-44fa-4aea-9ef8-2ea6694f70a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.886546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606eb84-44fa-4aea-9ef8-2ea6694f70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.886889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606eb84-44fa-4aea-9ef8-2ea6694f70a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.888056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606eb84-44fa-4aea-9ef8-2ea6694f70a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.890143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606eb84-44fa-4aea-9ef8-2ea6694f70a2 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.900666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1020/2072] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:12 2022] POST /identity/v3/users => generated 311 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:12.905921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1053/2073] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:12.907312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606eb84-44fa-4aea-9ef8-2ea6694f70a2 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.909030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f682ee5-5416-4aef-bf9d-50a0f5f52abf admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.918690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606eb84-44fa-4aea-9ef8-2ea6694f70a2 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.923888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f682ee5-5416-4aef-bf9d-50a0f5f52abf admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.924452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07190d7b-f388-4fd5-b8cc-95fff45647ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.925573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07190d7b-f388-4fd5-b8cc-95fff45647ce admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.925693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07190d7b-f388-4fd5-b8cc-95fff45647ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.926026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07190d7b-f388-4fd5-b8cc-95fff45647ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.926832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07190d7b-f388-4fd5-b8cc-95fff45647ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.928834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07190d7b-f388-4fd5-b8cc-95fff45647ce admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.932087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355509ff-b26a-4a6b-b7ec-e0d19c6f8bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.933715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355509ff-b26a-4a6b-b7ec-e0d19c6f8bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.934226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355509ff-b26a-4a6b-b7ec-e0d19c6f8bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.935047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355509ff-b26a-4a6b-b7ec-e0d19c6f8bca admin admin] PATH_INFO: `/v3/projects/f670d8b6033c48a1854a6021d485a54d/users/592fc2833d384827a2e3de8110867064/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.944492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1054/2074] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:12.951027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07190d7b-f388-4fd5-b8cc-95fff45647ce admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:12.958830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355509ff-b26a-4a6b-b7ec-e0d19c6f8bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=f670d8b6033c48a1854a6021d485a54d, user_id=592fc2833d384827a2e3de8110867064, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.961736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355509ff-b26a-4a6b-b7ec-e0d19c6f8bca admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.964647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07190d7b-f388-4fd5-b8cc-95fff45647ce admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:12.971495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aaf87-8116-422e-9d48-666f7b5e10d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:12.972382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aaf87-8116-422e-9d48-666f7b5e10d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.972673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aaf87-8116-422e-9d48-666f7b5e10d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.973240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2aaf87-8116-422e-9d48-666f7b5e10d9 admin admin] PATH_INFO: `/v3/projects/436016337d3b4a70b8bbfc09b710375d/users/ca777daf50c840659d11e711b4c14064/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:12.995519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1021/2075] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:12 2022] PUT /identity/v3/projects/f670d8b6033c48a1854a6021d485a54d/users/592fc2833d384827a2e3de8110867064/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:12.995691 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2aaf87-8116-422e-9d48-666f7b5e10d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436016337d3b4a70b8bbfc09b710375d, user_id=ca777daf50c840659d11e711b4c14064, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:12.996661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2aaf87-8116-422e-9d48-666f7b5e10d9 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:12.998741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb451b1-63c4-4b7c-8dea-915acc272fc0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:12.999287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb451b1-63c4-4b7c-8dea-915acc272fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:12.999630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb451b1-63c4-4b7c-8dea-915acc272fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.008329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:13.021687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1055/2076] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:12 2022] PUT /identity/v3/projects/436016337d3b4a70b8bbfc09b710375d/users/ca777daf50c840659d11e711b4c14064/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:13.022720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aaf87-8116-422e-9d48-666f7b5e10d9 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.041652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-4bb451b1-63c4-4b7c-8dea-915acc272fc0 None None] MFA Rules not processed for user `592fc2833d384827a2e3de8110867064`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:13.044037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4bb451b1-63c4-4b7c-8dea-915acc272fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.118359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2aaf87-8116-422e-9d48-666f7b5e10d9 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.129942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a797f4-aa71-46c2-bf56-38a55d0f87c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.130116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a797f4-aa71-46c2-bf56-38a55d0f87c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.130326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a797f4-aa71-46c2-bf56-38a55d0f87c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.130580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a797f4-aa71-46c2-bf56-38a55d0f87c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.131500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a797f4-aa71-46c2-bf56-38a55d0f87c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.133591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a797f4-aa71-46c2-bf56-38a55d0f87c7 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.144123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1022/2077] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:13.145615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb451b1-63c4-4b7c-8dea-915acc272fc0 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.150465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4bb451b1-63c4-4b7c-8dea-915acc272fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.156725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1056/2078] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:13.157177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a797f4-aa71-46c2-bf56-38a55d0f87c7 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.159583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-63a797f4-aa71-46c2-bf56-38a55d0f87c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.171885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb451b1-63c4-4b7c-8dea-915acc272fc0 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.177812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.178641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.178931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.179244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] PATH_INFO: `/v3/users/c5c663a9d73840de8f9878a31a4d65f3` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.187211 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c663a9d73840de8f9878a31a4d65f3)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.190256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.233570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a797f4-aa71-46c2-bf56-38a55d0f87c7 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.240804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d478a1-7122-4805-88ed-d10a7d9f2e0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.242353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d478a1-7122-4805-88ed-d10a7d9f2e0b service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.243227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d478a1-7122-4805-88ed-d10a7d9f2e0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.243681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d478a1-7122-4805-88ed-d10a7d9f2e0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.254547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d478a1-7122-4805-88ed-d10a7d9f2e0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.255478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c663a9d73840de8f9878a31a4d65f3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.256098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d478a1-7122-4805-88ed-d10a7d9f2e0b service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.256213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c663a9d73840de8f9878a31a4d65f3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.257449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c663a9d73840de8f9878a31a4d65f3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.267866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c663a9d73840de8f9878a31a4d65f3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.276071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1057/2079] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:13 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:13.276679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c663a9d73840de8f9878a31a4d65f3'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.277075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d478a1-7122-4805-88ed-d10a7d9f2e0b service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.288043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d478a1-7122-4805-88ed-d10a7d9f2e0b service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.294234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92fcbb-ae42-4940-8a31-d85ffea589a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.295100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92fcbb-ae42-4940-8a31-d85ffea589a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.295416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92fcbb-ae42-4940-8a31-d85ffea589a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.295703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92fcbb-ae42-4940-8a31-d85ffea589a1 admin admin] PATH_INFO: `/v3/projects/436016337d3b4a70b8bbfc09b710375d/users/ca777daf50c840659d11e711b4c14064/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.299124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92fcbb-ae42-4940-8a31-d85ffea589a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=436016337d3b4a70b8bbfc09b710375d, user_id=ca777daf50c840659d11e711b4c14064, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.301840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92fcbb-ae42-4940-8a31-d85ffea589a1 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.309213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1023/2080] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:13 2022] DELETE /identity/v3/users/c5c663a9d73840de8f9878a31a4d65f3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:13.310426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.313548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.318915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1058/2081] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:13 2022] PUT /identity/v3/projects/436016337d3b4a70b8bbfc09b710375d/users/ca777daf50c840659d11e711b4c14064/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:13.322110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:13.324594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91967b-acaa-4715-8a37-b72c7915f6dc None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.325108 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91967b-acaa-4715-8a37-b72c7915f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.325575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91967b-acaa-4715-8a37-b72c7915f6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.350976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-6e91967b-acaa-4715-8a37-b72c7915f6dc None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:13.352430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6e91967b-acaa-4715-8a37-b72c7915f6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.410613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24094beb-b22a-4fbc-9fdf-c52e69b94dcd admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.427317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1059/2082] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:13.428756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc905109-86c9-4088-b783-7a7fd5d7dfb5 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.429076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc905109-86c9-4088-b783-7a7fd5d7dfb5 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.429419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc905109-86c9-4088-b783-7a7fd5d7dfb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.470001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-dc905109-86c9-4088-b783-7a7fd5d7dfb5 None None] MFA Rules not processed for user `ca777daf50c840659d11e711b4c14064`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:13.471252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-dc905109-86c9-4088-b783-7a7fd5d7dfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.482124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.483097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.483561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.483849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] PATH_INFO: `/v3/projects/e0a5979121554841af71a07e290d748f` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.485436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:13.486149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a5979121554841af71a07e290d748f)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.488491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.554573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a5979121554841af71a07e290d748f', 'request_id': 'req-a174722a-e8f0-4cca-95d8-9b1e14ab424a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.557858 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1060/2083] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:13.558758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc905109-86c9-4088-b783-7a7fd5d7dfb5 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.560267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-dc905109-86c9-4088-b783-7a7fd5d7dfb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.569377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a5979121554841af71a07e290d748f', 'request_id': 'req-a174722a-e8f0-4cca-95d8-9b1e14ab424a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.581572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a5979121554841af71a07e290d748f', 'request_id': 'req-a174722a-e8f0-4cca-95d8-9b1e14ab424a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.591092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] The token cache is being invalidate because project e0a5979121554841af71a07e290d748f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:13.591392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.592085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.594377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1024/2084] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:13 2022] DELETE /identity/v3/projects/e0a5979121554841af71a07e290d748f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:13.594834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.596254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.645406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc905109-86c9-4088-b783-7a7fd5d7dfb5 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.648744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:13.670027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174722a-e8f0-4cca-95d8-9b1e14ab424a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.674944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456d3a7-fe75-4bbf-b943-0132466c2277 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.675715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456d3a7-fe75-4bbf-b943-0132466c2277 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.676070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456d3a7-fe75-4bbf-b943-0132466c2277 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.676463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5456d3a7-fe75-4bbf-b943-0132466c2277 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.679413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5456d3a7-fe75-4bbf-b943-0132466c2277 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.705746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09171a-68b9-4078-9910-ae0a08c0c918 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.706442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09171a-68b9-4078-9910-ae0a08c0c918 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.706730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09171a-68b9-4078-9910-ae0a08c0c918 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.707041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af09171a-68b9-4078-9910-ae0a08c0c918 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.709102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-af09171a-68b9-4078-9910-ae0a08c0c918 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.752018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456d3a7-fe75-4bbf-b943-0132466c2277 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.753483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5456d3a7-fe75-4bbf-b943-0132466c2277 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.764452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1025/2085] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:13.765549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456d3a7-fe75-4bbf-b943-0132466c2277 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.767254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5456d3a7-fe75-4bbf-b943-0132466c2277 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.795639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09171a-68b9-4078-9910-ae0a08c0c918 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.798591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af09171a-68b9-4078-9910-ae0a08c0c918 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.809930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1061/2086] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:13.831692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09171a-68b9-4078-9910-ae0a08c0c918 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:13.846267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af09171a-68b9-4078-9910-ae0a08c0c918 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.850946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe6099-fc7a-4445-b5fd-b363226ce083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.851633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6099-fc7a-4445-b5fd-b363226ce083 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.852126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6099-fc7a-4445-b5fd-b363226ce083 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.852549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe6099-fc7a-4445-b5fd-b363226ce083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.855300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4dfe6099-fc7a-4445-b5fd-b363226ce083 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:13.862948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5456d3a7-fe75-4bbf-b943-0132466c2277 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:13.869265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:13.870421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:13.870747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:13.871090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] PATH_INFO: `/v3/users/557884f4849a4511902ed5c5b24e4b21` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:13.872922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=557884f4849a4511902ed5c5b24e4b21)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.873763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:13.875337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.951944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557884f4849a4511902ed5c5b24e4b21'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.952875 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557884f4849a4511902ed5c5b24e4b21'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.954123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557884f4849a4511902ed5c5b24e4b21'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.963322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe6099-fc7a-4445-b5fd-b363226ce083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:13.964827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfe6099-fc7a-4445-b5fd-b363226ce083 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:13.971765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557884f4849a4511902ed5c5b24e4b21'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:13.988120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1062/2087] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:13.990497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557884f4849a4511902ed5c5b24e4b21'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.018576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1026/2088] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:13 2022] DELETE /identity/v3/users/557884f4849a4511902ed5c5b24e4b21 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:14.042616 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe6099-fc7a-4445-b5fd-b363226ce083 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.058819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe6099-fc7a-4445-b5fd-b363226ce083 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.156724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea467-c144-4705-85cd-96aad82e01bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.157679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea467-c144-4705-85cd-96aad82e01bd service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.157974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea467-c144-4705-85cd-96aad82e01bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.158258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0ea467-c144-4705-85cd-96aad82e01bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.160624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9c0ea467-c144-4705-85cd-96aad82e01bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:14.254004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.255600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:14.280545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:14.288316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ea467-c144-4705-85cd-96aad82e01bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.290106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0ea467-c144-4705-85cd-96aad82e01bd service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.302316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1063/2089] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:14.383143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f69d9-c77d-4772-968c-26a77fe443b9 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.388327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.389407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.390132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.391361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] PATH_INFO: `/v3/projects/4b8d6918eda941f49d50461de979d062` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.394423 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8d6918eda941f49d50461de979d062)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.396759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.467779 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8d6918eda941f49d50461de979d062', 'request_id': 'req-278bf15b-f8ee-4299-9c63-11cd551dbbd8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.476897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8d6918eda941f49d50461de979d062', 'request_id': 'req-278bf15b-f8ee-4299-9c63-11cd551dbbd8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.481056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea467-c144-4705-85cd-96aad82e01bd service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.482924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8d6918eda941f49d50461de979d062', 'request_id': 'req-278bf15b-f8ee-4299-9c63-11cd551dbbd8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.483249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9c0ea467-c144-4705-85cd-96aad82e01bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:14.496751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] The token cache is being invalidate because project 4b8d6918eda941f49d50461de979d062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:14.497110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.497836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-278bf15b-f8ee-4299-9c63-11cd551dbbd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.500682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1027/2090] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:14 2022] DELETE /identity/v3/projects/4b8d6918eda941f49d50461de979d062 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:14.505492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf966f-5687-455a-afb8-b7396c299690 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.505864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf966f-5687-455a-afb8-b7396c299690 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.506130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf966f-5687-455a-afb8-b7396c299690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.525575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0ea467-c144-4705-85cd-96aad82e01bd service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.528889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-aabf966f-5687-455a-afb8-b7396c299690 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:14.530275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-aabf966f-5687-455a-afb8-b7396c299690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:14.602764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.603689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.603980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.604267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] PATH_INFO: `/v3/projects/d0bab834e0d74b9d919f57a131c981e3` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.605594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0bab834e0d74b9d919f57a131c981e3)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.607668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.615041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:14.616582 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1028/2091] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:14.625452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08524-106d-4d7b-b307-5dedf72a956e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.625941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08524-106d-4d7b-b307-5dedf72a956e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.626071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c08524-106d-4d7b-b307-5dedf72a956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.663613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-f8c08524-106d-4d7b-b307-5dedf72a956e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:14.664677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f8c08524-106d-4d7b-b307-5dedf72a956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:14.685780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1029/2092] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:14.691230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c08524-106d-4d7b-b307-5dedf72a956e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.704641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c08524-106d-4d7b-b307-5dedf72a956e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.731250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0bab834e0d74b9d919f57a131c981e3', 'request_id': 'req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.747271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0bab834e0d74b9d919f57a131c981e3', 'request_id': 'req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.754130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:14.757543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0bab834e0d74b9d919f57a131c981e3', 'request_id': 'req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.775705 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] The token cache is being invalidate because project d0bab834e0d74b9d919f57a131c981e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:14.776001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.777976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.780200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1064/2093] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:14 2022] DELETE /identity/v3/projects/d0bab834e0d74b9d919f57a131c981e3 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:14.784533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.785862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:14.799861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48488a-5779-49d7-8e5c-2aa305dce70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.800538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48488a-5779-49d7-8e5c-2aa305dce70b admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.800834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48488a-5779-49d7-8e5c-2aa305dce70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.801116 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd48488a-5779-49d7-8e5c-2aa305dce70b admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.801890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48488a-5779-49d7-8e5c-2aa305dce70b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:14.802199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48488a-5779-49d7-8e5c-2aa305dce70b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.804238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd48488a-5779-49d7-8e5c-2aa305dce70b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.822450 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1030/2094] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:14.825356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48488a-5779-49d7-8e5c-2aa305dce70b admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.829504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bd48488a-5779-49d7-8e5c-2aa305dce70b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:14.848187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd48488a-5779-49d7-8e5c-2aa305dce70b admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.855892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1593c-375d-424a-a223-a7523f0ec1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.856588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1593c-375d-424a-a223-a7523f0ec1da admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.856841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1593c-375d-424a-a223-a7523f0ec1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.857123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1593c-375d-424a-a223-a7523f0ec1da admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.857816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1593c-375d-424a-a223-a7523f0ec1da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.860163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c1593c-375d-424a-a223-a7523f0ec1da admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.882859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fc9a4c-0097-41fa-ada1-bb6e797d26ad admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.888790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.891056 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.891448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.891831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] PATH_INFO: `/v3/users/42c1eee30d7a469ab5c17a36ea9a5728` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.893001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c1eee30d7a469ab5c17a36ea9a5728)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:14.894339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1031/2095] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:14 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:14.895427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:14.898283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1593c-375d-424a-a223-a7523f0ec1da admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:14.970264 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c1eee30d7a469ab5c17a36ea9a5728'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.971783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c1eee30d7a469ab5c17a36ea9a5728'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.972470 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c1eee30d7a469ab5c17a36ea9a5728'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.981045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c1eee30d7a469ab5c17a36ea9a5728'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.989590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1593c-375d-424a-a223-a7523f0ec1da admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:14.991801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c1eee30d7a469ab5c17a36ea9a5728'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:14.996015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23e63-5d84-40ae-9fea-f0f1b4463108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:14.996879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23e63-5d84-40ae-9fea-f0f1b4463108 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:14.997018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23e63-5d84-40ae-9fea-f0f1b4463108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:14.997432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc23e63-5d84-40ae-9fea-f0f1b4463108 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:14.998900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23e63-5d84-40ae-9fea-f0f1b4463108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.001041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc23e63-5d84-40ae-9fea-f0f1b4463108 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:15.014560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1065/2096] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:14 2022] DELETE /identity/v3/users/42c1eee30d7a469ab5c17a36ea9a5728 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:15.023458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1032/2097] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:14 2022] POST /identity/v3/users => generated 289 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:15.028084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:15.030175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:15.047116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:15.121221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83155c47-9585-492c-b92f-fc7f59bc21d0 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:15.127443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654708d7-d7cc-40c6-80a0-7085ed344d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:15.128135 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654708d7-d7cc-40c6-80a0-7085ed344d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.128424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654708d7-d7cc-40c6-80a0-7085ed344d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.128711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654708d7-d7cc-40c6-80a0-7085ed344d3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.129917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654708d7-d7cc-40c6-80a0-7085ed344d3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.131832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654708d7-d7cc-40c6-80a0-7085ed344d3a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:15.149732 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1066/2098] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:15.150835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23e63-5d84-40ae-9fea-f0f1b4463108 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:15.164561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc23e63-5d84-40ae-9fea-f0f1b4463108 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:15.173485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fdc524-3b9d-4d46-98b5-314a01ed8cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:15.175069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdc524-3b9d-4d46-98b5-314a01ed8cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.175541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdc524-3b9d-4d46-98b5-314a01ed8cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.176106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fdc524-3b9d-4d46-98b5-314a01ed8cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.177279 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdc524-3b9d-4d46-98b5-314a01ed8cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.188340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fdc524-3b9d-4d46-98b5-314a01ed8cd4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:15.202705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1033/2099] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:15.210733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654708d7-d7cc-40c6-80a0-7085ed344d3a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:15.228478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654708d7-d7cc-40c6-80a0-7085ed344d3a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:15.235759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d789be-6e47-43e5-873a-554f1be3d5e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:15.236661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d789be-6e47-43e5-873a-554f1be3d5e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.238423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d789be-6e47-43e5-873a-554f1be3d5e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.238689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d789be-6e47-43e5-873a-554f1be3d5e1 admin admin] PATH_INFO: `/v3/projects/d2ae18a90946454b9c1189c4a1dd4345/users/4d4a73d6301c49fb8732d1a6dc46a821/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.284434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d789be-6e47-43e5-873a-554f1be3d5e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2ae18a90946454b9c1189c4a1dd4345, user_id=4d4a73d6301c49fb8732d1a6dc46a821, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.289700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d789be-6e47-43e5-873a-554f1be3d5e1 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:15.338058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7561d2-8795-4ed6-875f-f1f390d32e79 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.338793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7561d2-8795-4ed6-875f-f1f390d32e79 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.338793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7561d2-8795-4ed6-875f-f1f390d32e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.340221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1067/2100] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:15 2022] PUT /identity/v3/projects/d2ae18a90946454b9c1189c4a1dd4345/users/4d4a73d6301c49fb8732d1a6dc46a821/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:15.375457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-bd7561d2-8795-4ed6-875f-f1f390d32e79 None None] MFA Rules not processed for user `4d4a73d6301c49fb8732d1a6dc46a821`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:15.377113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bd7561d2-8795-4ed6-875f-f1f390d32e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:15.467128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d789be-6e47-43e5-873a-554f1be3d5e1 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:15.470086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a7d789be-6e47-43e5-873a-554f1be3d5e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:15.515808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1034/2101] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:15.552521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7561d2-8795-4ed6-875f-f1f390d32e79 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:15.554605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bd7561d2-8795-4ed6-875f-f1f390d32e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:15.579147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:15.599011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d789be-6e47-43e5-873a-554f1be3d5e1 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:15.604049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:15.604877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.605167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.605436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] PATH_INFO: `/v3/projects/2cd8f0e7bc6042d186f8330a2193301a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.606916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd8f0e7bc6042d186f8330a2193301a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.608900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:15.654183 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7561d2-8795-4ed6-875f-f1f390d32e79 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:15.673401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd8f0e7bc6042d186f8330a2193301a', 'request_id': 'req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:15.685343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd8f0e7bc6042d186f8330a2193301a', 'request_id': 'req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:15.692798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd8f0e7bc6042d186f8330a2193301a', 'request_id': 'req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:15.708469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] The token cache is being invalidate because project 2cd8f0e7bc6042d186f8330a2193301a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:15.708767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:15.709594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8fb1401c-63e3-4d85-91c2-ce7c736a1e1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:15.711421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1068/2102] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:15 2022] DELETE /identity/v3/projects/2cd8f0e7bc6042d186f8330a2193301a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:15.716233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37eb0f-3ea0-4dc3-a278-653b9123f5c3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.716524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37eb0f-3ea0-4dc3-a278-653b9123f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.716805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e37eb0f-3ea0-4dc3-a278-653b9123f5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.741177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-7e37eb0f-3ea0-4dc3-a278-653b9123f5c3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:15.741796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b09ca-2bdf-49d5-a24e-2ad7bcfe9a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:15.742559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7e37eb0f-3ea0-4dc3-a278-653b9123f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:15.742675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b09ca-2bdf-49d5-a24e-2ad7bcfe9a8c service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.742899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b09ca-2bdf-49d5-a24e-2ad7bcfe9a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.743354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b09ca-2bdf-49d5-a24e-2ad7bcfe9a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.745944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-747b09ca-2bdf-49d5-a24e-2ad7bcfe9a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:15.754427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:15.829603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1069/2103] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:15.839684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fdb44-8ca9-4c64-a692-69290f614118 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.840408 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fdb44-8ca9-4c64-a692-69290f614118 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.840979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fdb44-8ca9-4c64-a692-69290f614118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.842114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b09ca-2bdf-49d5-a24e-2ad7bcfe9a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.844004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747b09ca-2bdf-49d5-a24e-2ad7bcfe9a8c service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:15.869465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1035/2104] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:15.870372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-840fdb44-8ca9-4c64-a692-69290f614118 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:15.873958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-840fdb44-8ca9-4c64-a692-69290f614118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:15.894412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1070/2105] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:15.895236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b09ca-2bdf-49d5-a24e-2ad7bcfe9a8c service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:15.895236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-747b09ca-2bdf-49d5-a24e-2ad7bcfe9a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:15.899975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fdb44-8ca9-4c64-a692-69290f614118 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:15.911745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fdb44-8ca9-4c64-a692-69290f614118 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:15.915737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b09ca-2bdf-49d5-a24e-2ad7bcfe9a8c service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:15.920869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def023f-1e6f-4078-886b-d898375fdb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:15.922053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def023f-1e6f-4078-886b-d898375fdb1a admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.922353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def023f-1e6f-4078-886b-d898375fdb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.922841 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def023f-1e6f-4078-886b-d898375fdb1a admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.923703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def023f-1e6f-4078-886b-d898375fdb1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:15.924014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def023f-1e6f-4078-886b-d898375fdb1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.926315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def023f-1e6f-4078-886b-d898375fdb1a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:15.930548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:15.931450 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.931730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.932003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] PATH_INFO: `/v3/users/592fc2833d384827a2e3de8110867064` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.933223 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=592fc2833d384827a2e3de8110867064)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.935735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:15.956059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1071/2106] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:19:15.956637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def023f-1e6f-4078-886b-d898375fdb1a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:15.975291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def023f-1e6f-4078-886b-d898375fdb1a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:15.981880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d45a7-f039-41dd-87a6-f5e4d079cc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:15.982989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d45a7-f039-41dd-87a6-f5e4d079cc91 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:15.983456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d45a7-f039-41dd-87a6-f5e4d079cc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:15.983965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9d45a7-f039-41dd-87a6-f5e4d079cc91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:15.985086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d45a7-f039-41dd-87a6-f5e4d079cc91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:15.987559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9d45a7-f039-41dd-87a6-f5e4d079cc91 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.030638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1072/2107] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:15 2022] POST /identity/v3/projects => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:16.032690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592fc2833d384827a2e3de8110867064'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.033461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592fc2833d384827a2e3de8110867064'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.034102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592fc2833d384827a2e3de8110867064'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.034371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d45a7-f039-41dd-87a6-f5e4d079cc91 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.036852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1c9d45a7-f039-41dd-87a6-f5e4d079cc91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:16.048666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592fc2833d384827a2e3de8110867064'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.060390 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-db237639-6120-4454-b483-432c8a38be47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592fc2833d384827a2e3de8110867064'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.079342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:16.092632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1036/2108] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:15 2022] DELETE /identity/v3/users/592fc2833d384827a2e3de8110867064 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:16.100570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606461e-fe1b-42ae-9453-f1d32a812e9b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.101137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606461e-fe1b-42ae-9453-f1d32a812e9b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.101459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606461e-fe1b-42ae-9453-f1d32a812e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.129322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-a606461e-fe1b-42ae-9453-f1d32a812e9b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:16.130640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a606461e-fe1b-42ae-9453-f1d32a812e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:16.137925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9d45a7-f039-41dd-87a6-f5e4d079cc91 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:16.205513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1037/2109] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:16.217721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606461e-fe1b-42ae-9453-f1d32a812e9b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.220491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a606461e-fe1b-42ae-9453-f1d32a812e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:16.246827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b034f2-0b9f-4642-bb04-903c174ae0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:16.247577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b034f2-0b9f-4642-bb04-903c174ae0c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.248059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b034f2-0b9f-4642-bb04-903c174ae0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.248408 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b034f2-0b9f-4642-bb04-903c174ae0c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.249618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b034f2-0b9f-4642-bb04-903c174ae0c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:16.252768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b034f2-0b9f-4642-bb04-903c174ae0c9 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.301343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1073/2110] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:16 2022] POST /identity/v3/users => generated 284 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:16.302542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b034f2-0b9f-4642-bb04-903c174ae0c9 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.313958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b034f2-0b9f-4642-bb04-903c174ae0c9 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:16.319698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7a061-5dac-4924-9334-9c5973576ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:16.320495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a061-5dac-4924-9334-9c5973576ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.320779 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606461e-fe1b-42ae-9453-f1d32a812e9b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:16.320909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a061-5dac-4924-9334-9c5973576ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.321079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a061-5dac-4924-9334-9c5973576ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.321847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7a061-5dac-4924-9334-9c5973576ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:16.323561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7a061-5dac-4924-9334-9c5973576ef5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.324551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794243ff-3c42-48ed-8153-20467edb5839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:16.325230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794243ff-3c42-48ed-8153-20467edb5839 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.325515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794243ff-3c42-48ed-8153-20467edb5839 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.325804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794243ff-3c42-48ed-8153-20467edb5839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.330323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:16.338636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794243ff-3c42-48ed-8153-20467edb5839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:16.340143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794243ff-3c42-48ed-8153-20467edb5839 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.343227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1074/2111] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:16.347589 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7a061-5dac-4924-9334-9c5973576ef5 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.355133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1038/2112] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:16.361604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7a061-5dac-4924-9334-9c5973576ef5 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:16.367359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612062fa-1d75-492b-8193-85bb3a29f865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:16.368040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612062fa-1d75-492b-8193-85bb3a29f865 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.368320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612062fa-1d75-492b-8193-85bb3a29f865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.368596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612062fa-1d75-492b-8193-85bb3a29f865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.369352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612062fa-1d75-492b-8193-85bb3a29f865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:16.370999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612062fa-1d75-492b-8193-85bb3a29f865 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.383463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1075/2113] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:16.387488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794243ff-3c42-48ed-8153-20467edb5839 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.397113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794243ff-3c42-48ed-8153-20467edb5839 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:16.402152 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e78a5-327f-428a-99c1-2258ba233bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:16.403156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e78a5-327f-428a-99c1-2258ba233bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.403515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e78a5-327f-428a-99c1-2258ba233bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.403835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269e78a5-327f-428a-99c1-2258ba233bde admin admin] PATH_INFO: `/v3/projects/572b6d6eaac4487094e15477930db4a8/users/5d72e0c731224e92a897e82a6c0e6e55/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.422658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e78a5-327f-428a-99c1-2258ba233bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=572b6d6eaac4487094e15477930db4a8, user_id=5d72e0c731224e92a897e82a6c0e6e55, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:16.425674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269e78a5-327f-428a-99c1-2258ba233bde admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.440982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1039/2114] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:16 2022] PUT /identity/v3/projects/572b6d6eaac4487094e15477930db4a8/users/5d72e0c731224e92a897e82a6c0e6e55/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:16.451673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283d94-4e5a-41e5-9404-3c053375396e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.451965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283d94-4e5a-41e5-9404-3c053375396e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.452245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b283d94-4e5a-41e5-9404-3c053375396e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.480631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-4b283d94-4e5a-41e5-9404-3c053375396e None None] MFA Rules not processed for user `5d72e0c731224e92a897e82a6c0e6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:16.481872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4b283d94-4e5a-41e5-9404-3c053375396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:16.552198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1076/2115] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:16.564969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e78a5-327f-428a-99c1-2258ba233bde admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.566740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-269e78a5-327f-428a-99c1-2258ba233bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:16.637545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269e78a5-327f-428a-99c1-2258ba233bde admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:16.642000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec2d52-0322-4033-850d-6fa295685984 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210e10ee6b649399de11ac719a89718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:16.642829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec2d52-0322-4033-850d-6fa295685984 service glance] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.643209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec2d52-0322-4033-850d-6fa295685984 service glance] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.643732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec2d52-0322-4033-850d-6fa295685984 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.652948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec2d52-0322-4033-850d-6fa295685984 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:16.654440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aec2d52-0322-4033-850d-6fa295685984 service glance] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.662628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b283d94-4e5a-41e5-9404-3c053375396e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:16.664419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4b283d94-4e5a-41e5-9404-3c053375396e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:16.665517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1040/2116] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:16.745073 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b283d94-4e5a-41e5-9404-3c053375396e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:16.756196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:16.757079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.757362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.757637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] PATH_INFO: `/v3/projects/f670d8b6033c48a1854a6021d485a54d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.758853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f670d8b6033c48a1854a6021d485a54d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:16.760864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:16.827998 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f670d8b6033c48a1854a6021d485a54d', 'request_id': 'req-566d146e-9ee1-4780-8bbb-949263f2d499'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.837166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f670d8b6033c48a1854a6021d485a54d', 'request_id': 'req-566d146e-9ee1-4780-8bbb-949263f2d499'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.845536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f670d8b6033c48a1854a6021d485a54d', 'request_id': 'req-566d146e-9ee1-4780-8bbb-949263f2d499'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.860813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] The token cache is being invalidate because project f670d8b6033c48a1854a6021d485a54d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:16.861111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.861897 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-566d146e-9ee1-4780-8bbb-949263f2d499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:16.863518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1077/2117] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:16 2022] DELETE /identity/v3/projects/f670d8b6033c48a1854a6021d485a54d => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:16.869961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16afde-15b6-4722-b89d-6885b3445f77 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.870255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16afde-15b6-4722-b89d-6885b3445f77 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.870536 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc16afde-15b6-4722-b89d-6885b3445f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:16.889658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-cc16afde-15b6-4722-b89d-6885b3445f77 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:16.890922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-cc16afde-15b6-4722-b89d-6885b3445f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:16.905396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:16.973945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1041/2118] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:16.981868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cf631-1b3a-4865-a29b-29e6ae370813 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:16.982366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cf631-1b3a-4865-a29b-29e6ae370813 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:16.982487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cf631-1b3a-4865-a29b-29e6ae370813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.004990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-182cf631-1b3a-4865-a29b-29e6ae370813 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:17.006463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-182cf631-1b3a-4865-a29b-29e6ae370813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:17.014861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1078/2119] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:17.020603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16afde-15b6-4722-b89d-6885b3445f77 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.033397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc16afde-15b6-4722-b89d-6885b3445f77 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.038867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bdcec-4803-4a17-8cc1-0495379698dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.040088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bdcec-4803-4a17-8cc1-0495379698dc admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.040088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bdcec-4803-4a17-8cc1-0495379698dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.040282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344bdcec-4803-4a17-8cc1-0495379698dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.041020 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bdcec-4803-4a17-8cc1-0495379698dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:17.041399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bdcec-4803-4a17-8cc1-0495379698dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.043838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344bdcec-4803-4a17-8cc1-0495379698dc admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.058328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1042/2120] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:17.063696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cf631-1b3a-4865-a29b-29e6ae370813 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.068165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:17.074739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cf631-1b3a-4865-a29b-29e6ae370813 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.082610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a326f1-f9ce-49c3-a353-f4ac221aab8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.083301 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a326f1-f9ce-49c3-a353-f4ac221aab8f admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.083589 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a326f1-f9ce-49c3-a353-f4ac221aab8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.083863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a326f1-f9ce-49c3-a353-f4ac221aab8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.084553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a326f1-f9ce-49c3-a353-f4ac221aab8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.086475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a326f1-f9ce-49c3-a353-f4ac221aab8f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.114382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1079/2121] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:17 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:17.118703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bdcec-4803-4a17-8cc1-0495379698dc admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.128864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344bdcec-4803-4a17-8cc1-0495379698dc admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.199901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a56dc4-9d3a-40d5-acdb-a519a8799bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.200651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a56dc4-9d3a-40d5-acdb-a519a8799bd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.201008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a56dc4-9d3a-40d5-acdb-a519a8799bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.201341 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a56dc4-9d3a-40d5-acdb-a519a8799bd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.202275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a56dc4-9d3a-40d5-acdb-a519a8799bd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.204838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a56dc4-9d3a-40d5-acdb-a519a8799bd2 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.231810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1043/2122] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:17 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:17.233416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a326f1-f9ce-49c3-a353-f4ac221aab8f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.247426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a326f1-f9ce-49c3-a353-f4ac221aab8f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.253112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017ebef-c64e-4def-8388-471d1c51ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.253785 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017ebef-c64e-4def-8388-471d1c51ff51 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.254094 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017ebef-c64e-4def-8388-471d1c51ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.254987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017ebef-c64e-4def-8388-471d1c51ff51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.255162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017ebef-c64e-4def-8388-471d1c51ff51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.256775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a017ebef-c64e-4def-8388-471d1c51ff51 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.274822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1080/2123] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:17.275695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a56dc4-9d3a-40d5-acdb-a519a8799bd2 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.291615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a56dc4-9d3a-40d5-acdb-a519a8799bd2 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.298505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f7e45d-9f18-4399-bf3a-9049abb53feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.299666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7e45d-9f18-4399-bf3a-9049abb53feb admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.299972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7e45d-9f18-4399-bf3a-9049abb53feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.300315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f7e45d-9f18-4399-bf3a-9049abb53feb admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.302311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7e45d-9f18-4399-bf3a-9049abb53feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.304497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f7e45d-9f18-4399-bf3a-9049abb53feb admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.318418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1044/2124] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:17.321930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017ebef-c64e-4def-8388-471d1c51ff51 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.333329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017ebef-c64e-4def-8388-471d1c51ff51 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.339362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff8b3c-8540-4c20-a147-f354540b4b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.340393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff8b3c-8540-4c20-a147-f354540b4b61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.340694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff8b3c-8540-4c20-a147-f354540b4b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.340977 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff8b3c-8540-4c20-a147-f354540b4b61 admin admin] PATH_INFO: `/v3/projects/519642209df049748eabeb622eeb2529/users/229d8a6882dc4b61b87028d95d2db1d8/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.358899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff8b3c-8540-4c20-a147-f354540b4b61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519642209df049748eabeb622eeb2529, user_id=229d8a6882dc4b61b87028d95d2db1d8, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.362304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff8b3c-8540-4c20-a147-f354540b4b61 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.379249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1081/2125] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:17 2022] PUT /identity/v3/projects/519642209df049748eabeb622eeb2529/users/229d8a6882dc4b61b87028d95d2db1d8/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:17.389509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652c3d-ae30-4407-8844-83713685f47c None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.389807 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652c3d-ae30-4407-8844-83713685f47c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.390085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62652c3d-ae30-4407-8844-83713685f47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.418657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-62652c3d-ae30-4407-8844-83713685f47c None None] MFA Rules not processed for user `229d8a6882dc4b61b87028d95d2db1d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:17.420071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-62652c3d-ae30-4407-8844-83713685f47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:17.508739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1045/2126] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:17.546149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff8b3c-8540-4c20-a147-f354540b4b61 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:17.549530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-92ff8b3c-8540-4c20-a147-f354540b4b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:17.611514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff8b3c-8540-4c20-a147-f354540b4b61 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:17.620580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd140-423e-4e55-9690-df9f4b9cf8de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:17.621353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd140-423e-4e55-9690-df9f4b9cf8de service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:17.621667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd140-423e-4e55-9690-df9f4b9cf8de service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:17.622102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd140-423e-4e55-9690-df9f4b9cf8de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:17.634357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfd140-423e-4e55-9690-df9f4b9cf8de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:17.635918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfd140-423e-4e55-9690-df9f4b9cf8de service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:17.647126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1082/2127] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:19.396495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652c3d-ae30-4407-8844-83713685f47c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:19.398032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-62652c3d-ae30-4407-8844-83713685f47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:19.428683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:19.500153 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62652c3d-ae30-4407-8844-83713685f47c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:19.505856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:19.506764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:19.507076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:19.507364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] PATH_INFO: `/v3/users/0f6648643cf44b8c96a07acfa9714aae` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:19.508847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6648643cf44b8c96a07acfa9714aae)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:19.510765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:19.583326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6648643cf44b8c96a07acfa9714aae'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:19.584074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6648643cf44b8c96a07acfa9714aae'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:19.585003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6648643cf44b8c96a07acfa9714aae'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:19.597384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6648643cf44b8c96a07acfa9714aae'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:19.607723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6648643cf44b8c96a07acfa9714aae'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:19.628894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1046/2128] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:19 2022] DELETE /identity/v3/users/0f6648643cf44b8c96a07acfa9714aae => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:19.633678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633bf4-25d6-419d-934e-64cd0976cf2e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:19.634183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633bf4-25d6-419d-934e-64cd0976cf2e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:19.634381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe633bf4-25d6-419d-934e-64cd0976cf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:19.652650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fe633bf4-25d6-419d-934e-64cd0976cf2e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:19.654066 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fe633bf4-25d6-419d-934e-64cd0976cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:19.716034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1083/2129] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:19.725714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:19.727295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:19.786604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffade39-fb2c-40cc-8a61-82ebca62d32a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:19.790285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cde5e-5894-4ef3-aeb9-f79c554987b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:19.790942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cde5e-5894-4ef3-aeb9-f79c554987b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:19.791256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cde5e-5894-4ef3-aeb9-f79c554987b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:19.791537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845cde5e-5894-4ef3-aeb9-f79c554987b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:19.800684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cde5e-5894-4ef3-aeb9-f79c554987b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:19.802128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845cde5e-5894-4ef3-aeb9-f79c554987b3 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:19.811793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1047/2130] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:20.143707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe633bf4-25d6-419d-934e-64cd0976cf2e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:20.145844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fe633bf4-25d6-419d-934e-64cd0976cf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:20.196418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe633bf4-25d6-419d-934e-64cd0976cf2e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:20.203334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:20.204389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:20.204747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:20.205103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] PATH_INFO: `/v3/projects/56ea29f8e3b34d95857311e10d43e477` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:20.206411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ea29f8e3b34d95857311e10d43e477)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:20.208750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:20.260409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:20.264570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ea29f8e3b34d95857311e10d43e477', 'request_id': 'req-de649c6b-b193-4535-bc16-5380906b0897'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.274075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ea29f8e3b34d95857311e10d43e477', 'request_id': 'req-de649c6b-b193-4535-bc16-5380906b0897'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.283276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ea29f8e3b34d95857311e10d43e477', 'request_id': 'req-de649c6b-b193-4535-bc16-5380906b0897'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.284147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cde5e-5894-4ef3-aeb9-f79c554987b3 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:20.285596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-845cde5e-5894-4ef3-aeb9-f79c554987b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:20.292194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] The token cache is being invalidate because project 56ea29f8e3b34d95857311e10d43e477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:20.292194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.292856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.294387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1084/2131] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:20 2022] DELETE /identity/v3/projects/56ea29f8e3b34d95857311e10d43e477 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:20.299026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:20.299376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845cde5e-5894-4ef3-aeb9-f79c554987b3 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:20.300565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:20.337945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:20.374096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:20.376133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:20.376492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:20.377162 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] PATH_INFO: `/v3/users/cbe4377c00074301994a7ed8f60e313a` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:20.378602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe4377c00074301994a7ed8f60e313a)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:20.381024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:20.393453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de649c6b-b193-4535-bc16-5380906b0897 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:20.398621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:20.399546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:20.399830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:20.400137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] PATH_INFO: `/v3/users/f49b048781c34a448233722e6eef9d9a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:20.401709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f49b048781c34a448233722e6eef9d9a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:20.404562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:20.447948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe4377c00074301994a7ed8f60e313a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.448607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe4377c00074301994a7ed8f60e313a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.449241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe4377c00074301994a7ed8f60e313a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.463163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe4377c00074301994a7ed8f60e313a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.483227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f49b048781c34a448233722e6eef9d9a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.484599 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04e5a892-dd60-4630-b419-e16b8b03bee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe4377c00074301994a7ed8f60e313a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.484950 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f49b048781c34a448233722e6eef9d9a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.486302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f49b048781c34a448233722e6eef9d9a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.500379 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f49b048781c34a448233722e6eef9d9a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.517192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1048/2132] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:20 2022] DELETE /identity/v3/users/cbe4377c00074301994a7ed8f60e313a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:20.525488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d177d-2f77-47dd-9419-412e40d81ac2 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:20.525805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d177d-2f77-47dd-9419-412e40d81ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:20.526087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5d177d-2f77-47dd-9419-412e40d81ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:20.527667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f49b048781c34a448233722e6eef9d9a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:20.582442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-3c5d177d-2f77-47dd-9419-412e40d81ac2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:20.584047 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3c5d177d-2f77-47dd-9419-412e40d81ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:20.585536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1085/2133] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:20 2022] DELETE /identity/v3/users/f49b048781c34a448233722e6eef9d9a => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:20.752306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1049/2134] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:20.776122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:20.778845 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:20.923207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4c272-bdce-4512-8e8e-8ea740e23dba admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:20.927433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f9600-e0a7-4de1-aaba-6e007973e384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:20.928146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f9600-e0a7-4de1-aaba-6e007973e384 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:20.928439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f9600-e0a7-4de1-aaba-6e007973e384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:20.928722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f9600-e0a7-4de1-aaba-6e007973e384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:20.939372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:20.952253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f9600-e0a7-4de1-aaba-6e007973e384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:20.956312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f9600-e0a7-4de1-aaba-6e007973e384 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:20.982406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1086/2135] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:21.132001 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d177d-2f77-47dd-9419-412e40d81ac2 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:21.133489 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3c5d177d-2f77-47dd-9419-412e40d81ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:21.152956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5d177d-2f77-47dd-9419-412e40d81ac2 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:21.175032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:21.175927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.176233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.176490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] PATH_INFO: `/v3/projects/0f10bc15fd3041a788a23b7e044ba912` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.191747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f10bc15fd3041a788a23b7e044ba912)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:21.197493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:21.270099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f10bc15fd3041a788a23b7e044ba912', 'request_id': 'req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.271793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:21.278907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f10bc15fd3041a788a23b7e044ba912', 'request_id': 'req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.288215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f10bc15fd3041a788a23b7e044ba912', 'request_id': 'req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.300468 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] The token cache is being invalidate because project 0f10bc15fd3041a788a23b7e044ba912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:21.300759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.301423 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.303016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1050/2136] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:21 2022] DELETE /identity/v3/projects/0f10bc15fd3041a788a23b7e044ba912 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:21.308304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b0b7-ac5d-4907-a30c-157fe64c4f47 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.308664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b0b7-ac5d-4907-a30c-157fe64c4f47 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.309045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b0b7-ac5d-4907-a30c-157fe64c4f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.322902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:21.324929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:21.329377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2a55b0b7-ac5d-4907-a30c-157fe64c4f47 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:21.330784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2a55b0b7-ac5d-4907-a30c-157fe64c4f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:21.395188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1087/2137] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:21.402839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c8a82-20bd-41d8-a346-2dc12802f0b1 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.403164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c8a82-20bd-41d8-a346-2dc12802f0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.403444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2c8a82-20bd-41d8-a346-2dc12802f0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.404452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf23cf7-3ae3-4908-a2c1-f00a702afa7e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:21.409818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:21.410809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.411164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.411439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] PATH_INFO: `/v3/projects/ba58266901714c17b346905c3889d0d9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.412639 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba58266901714c17b346905c3889d0d9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:21.414604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:21.422785 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fe2c8a82-20bd-41d8-a346-2dc12802f0b1 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:21.424033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fe2c8a82-20bd-41d8-a346-2dc12802f0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:21.432086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1088/2138] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:21.436505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c8a82-20bd-41d8-a346-2dc12802f0b1 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:21.447191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2c8a82-20bd-41d8-a346-2dc12802f0b1 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:21.452891 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220a074-dcc3-43e0-ae9b-ef5f57dcd864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:21.453703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220a074-dcc3-43e0-ae9b-ef5f57dcd864 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.453993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220a074-dcc3-43e0-ae9b-ef5f57dcd864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.454275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220a074-dcc3-43e0-ae9b-ef5f57dcd864 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.455445 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220a074-dcc3-43e0-ae9b-ef5f57dcd864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:21.456124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220a074-dcc3-43e0-ae9b-ef5f57dcd864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:21.457413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5220a074-dcc3-43e0-ae9b-ef5f57dcd864 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:21.464394 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba58266901714c17b346905c3889d0d9', 'request_id': 'req-2d322763-3bcd-40ed-9387-adae6c7941f7'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.474985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1089/2139] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:19:21.476998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba58266901714c17b346905c3889d0d9', 'request_id': 'req-2d322763-3bcd-40ed-9387-adae6c7941f7'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.477114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220a074-dcc3-43e0-ae9b-ef5f57dcd864 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:21.485581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba58266901714c17b346905c3889d0d9', 'request_id': 'req-2d322763-3bcd-40ed-9387-adae6c7941f7'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.488726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220a074-dcc3-43e0-ae9b-ef5f57dcd864 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:21.496982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] The token cache is being invalidate because project ba58266901714c17b346905c3889d0d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:21.497268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.497928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.500028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1051/2140] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:21 2022] DELETE /identity/v3/projects/ba58266901714c17b346905c3889d0d9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:21.504027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:21.505314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:21.546863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a34a9-a491-468c-b449-7859ebede977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:21.547557 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a34a9-a491-468c-b449-7859ebede977 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.547851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a34a9-a491-468c-b449-7859ebede977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.548130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a34a9-a491-468c-b449-7859ebede977 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.548820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a34a9-a491-468c-b449-7859ebede977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:21.550763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a34a9-a491-468c-b449-7859ebede977 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:21.570884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d322763-3bcd-40ed-9387-adae6c7941f7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:21.575957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:21.576831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.577115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.577580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] PATH_INFO: `/v3/users/ca777daf50c840659d11e711b4c14064` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.578642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca777daf50c840659d11e711b4c14064)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:21.579043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1090/2141] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:21 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:21.580645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:21.583129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a34a9-a491-468c-b449-7859ebede977 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:21.584742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d86a34a9-a491-468c-b449-7859ebede977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:21.592074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:21.634096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca777daf50c840659d11e711b4c14064'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.634700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca777daf50c840659d11e711b4c14064'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.635348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca777daf50c840659d11e711b4c14064'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.643466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca777daf50c840659d11e711b4c14064'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.651853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca777daf50c840659d11e711b4c14064'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:21.658284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a34a9-a491-468c-b449-7859ebede977 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:21.663431 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ba59f-b1b4-454f-9073-7f220d19a611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:21.664137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ba59f-b1b4-454f-9073-7f220d19a611 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.664433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ba59f-b1b4-454f-9073-7f220d19a611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.664759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3ba59f-b1b4-454f-9073-7f220d19a611 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.665496 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ba59f-b1b4-454f-9073-7f220d19a611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:21.667569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3ba59f-b1b4-454f-9073-7f220d19a611 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:21.677740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1052/2142] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:21 2022] DELETE /identity/v3/users/ca777daf50c840659d11e711b4c14064 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:21.679112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:21.698120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1091/2143] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:21 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:21.699778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:21.700803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:21.773236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7fe1b9-3917-4ee0-8e60-d7aeb0c1b398 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:21.777942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b02c5-bdf1-47cd-97ed-839b810b95ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:21.778619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b02c5-bdf1-47cd-97ed-839b810b95ac admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.778908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b02c5-bdf1-47cd-97ed-839b810b95ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.779232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b02c5-bdf1-47cd-97ed-839b810b95ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.779968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b02c5-bdf1-47cd-97ed-839b810b95ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:21.782159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9b02c5-bdf1-47cd-97ed-839b810b95ac admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:21.798532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1053/2144] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:21.802915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ba59f-b1b4-454f-9073-7f220d19a611 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:21.813774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3ba59f-b1b4-454f-9073-7f220d19a611 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:21.818648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca3e8fb-7619-4aa9-9b07-dba357bfba7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:21.819435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e8fb-7619-4aa9-9b07-dba357bfba7c admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.819793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e8fb-7619-4aa9-9b07-dba357bfba7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.820141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca3e8fb-7619-4aa9-9b07-dba357bfba7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.820951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3e8fb-7619-4aa9-9b07-dba357bfba7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:21.822643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca3e8fb-7619-4aa9-9b07-dba357bfba7c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:21.835000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1092/2145] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:21.838548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b02c5-bdf1-47cd-97ed-839b810b95ac admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:21.851658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b02c5-bdf1-47cd-97ed-839b810b95ac admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:21.867813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ac519-94ce-433a-9df0-9f2884fa40a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:21.868736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ac519-94ce-433a-9df0-9f2884fa40a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.869025 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ac519-94ce-433a-9df0-9f2884fa40a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.869307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ac519-94ce-433a-9df0-9f2884fa40a2 admin admin] PATH_INFO: `/v3/projects/8484053a65b94b809c3556df8a8eb761/users/75dc3b57990a47baa31100b2e0911de8/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.890579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ac519-94ce-433a-9df0-9f2884fa40a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8484053a65b94b809c3556df8a8eb761, user_id=75dc3b57990a47baa31100b2e0911de8, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:21.893942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ac519-94ce-433a-9df0-9f2884fa40a2 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:21.913809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1054/2146] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:21 2022] PUT /identity/v3/projects/8484053a65b94b809c3556df8a8eb761/users/75dc3b57990a47baa31100b2e0911de8/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:21.926030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841738-0898-4396-9ee8-d135427688f2 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:21.926330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841738-0898-4396-9ee8-d135427688f2 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:21.926670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72841738-0898-4396-9ee8-d135427688f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:21.966368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-72841738-0898-4396-9ee8-d135427688f2 None None] MFA Rules not processed for user `75dc3b57990a47baa31100b2e0911de8`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:21.968550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-72841738-0898-4396-9ee8-d135427688f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:22.064061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1093/2147] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:22.069082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ac519-94ce-433a-9df0-9f2884fa40a2 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.079799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841738-0898-4396-9ee8-d135427688f2 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.082211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-72841738-0898-4396-9ee8-d135427688f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:22.196704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72841738-0898-4396-9ee8-d135427688f2 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.202294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ac519-94ce-433a-9df0-9f2884fa40a2 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.211832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.212736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.213021 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.213301 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] PATH_INFO: `/v3/projects/436016337d3b4a70b8bbfc09b710375d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.214530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=436016337d3b4a70b8bbfc09b710375d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.216889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.222946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6b4d9-40ea-4a19-a4d7-aaac174bf243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.224856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b4d9-40ea-4a19-a4d7-aaac174bf243 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.225593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b4d9-40ea-4a19-a4d7-aaac174bf243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.226191 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6b4d9-40ea-4a19-a4d7-aaac174bf243 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.227136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6b4d9-40ea-4a19-a4d7-aaac174bf243 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.230170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6b4d9-40ea-4a19-a4d7-aaac174bf243 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.236126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:22.282074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1055/2148] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:22 2022] POST /identity/v3/projects => generated 387 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:22.286463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6b4d9-40ea-4a19-a4d7-aaac174bf243 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.309883 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '436016337d3b4a70b8bbfc09b710375d', 'request_id': 'req-cbeb7443-f937-4670-a5ab-e715fe51ee75'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:22.331774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '436016337d3b4a70b8bbfc09b710375d', 'request_id': 'req-cbeb7443-f937-4670-a5ab-e715fe51ee75'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:22.339856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '436016337d3b4a70b8bbfc09b710375d', 'request_id': 'req-cbeb7443-f937-4670-a5ab-e715fe51ee75'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:22.350017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:22.363400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] The token cache is being invalidate because project 436016337d3b4a70b8bbfc09b710375d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:22.364157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:22.365062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-cbeb7443-f937-4670-a5ab-e715fe51ee75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:22.367316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1094/2149] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:22 2022] DELETE /identity/v3/projects/436016337d3b4a70b8bbfc09b710375d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:22.372283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd2cc3-bebb-41ae-9854-0bcec6a84833 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.373184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd2cc3-bebb-41ae-9854-0bcec6a84833 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.374000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd2cc3-bebb-41ae-9854-0bcec6a84833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.413259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-07bd2cc3-bebb-41ae-9854-0bcec6a84833 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:22.413826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6b4d9-40ea-4a19-a4d7-aaac174bf243 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.414493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-07bd2cc3-bebb-41ae-9854-0bcec6a84833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:22.502513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1095/2150] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:22.502513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00b0e7-2955-44e7-9c5e-154eea1d2047 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.503326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00b0e7-2955-44e7-9c5e-154eea1d2047 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.503552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00b0e7-2955-44e7-9c5e-154eea1d2047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.523375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8da6-597c-45c2-a4ed-5a2b841d71e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.524196 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8da6-597c-45c2-a4ed-5a2b841d71e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.524489 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8da6-597c-45c2-a4ed-5a2b841d71e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.524760 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1d8da6-597c-45c2-a4ed-5a2b841d71e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.531064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ae00b0e7-2955-44e7-9c5e-154eea1d2047 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:22.532003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d8da6-597c-45c2-a4ed-5a2b841d71e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.534242 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1d8da6-597c-45c2-a4ed-5a2b841d71e3 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.534798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ae00b0e7-2955-44e7-9c5e-154eea1d2047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:22.545540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1096/2151] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:22.551411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00b0e7-2955-44e7-9c5e-154eea1d2047 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.567642 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00b0e7-2955-44e7-9c5e-154eea1d2047 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.574680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e15481-fca3-4c1d-be17-edee52441e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.575111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1056/2152] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:22 2022] POST /identity/v3/users => generated 294 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:22.576171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e15481-fca3-4c1d-be17-edee52441e6b admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.576934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e15481-fca3-4c1d-be17-edee52441e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.579106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e15481-fca3-4c1d-be17-edee52441e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.581613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8da6-597c-45c2-a4ed-5a2b841d71e3 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.581746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e15481-fca3-4c1d-be17-edee52441e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:22.582032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e15481-fca3-4c1d-be17-edee52441e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.584127 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e15481-fca3-4c1d-be17-edee52441e6b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.584884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8d1d8da6-597c-45c2-a4ed-5a2b841d71e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:22.600461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1d8da6-597c-45c2-a4ed-5a2b841d71e3 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.610527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1097/2153] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:22.612079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36e6ec-d325-4afe-8655-f1406eb85d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.612660 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36e6ec-d325-4afe-8655-f1406eb85d65 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.613026 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36e6ec-d325-4afe-8655-f1406eb85d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.613220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d36e6ec-d325-4afe-8655-f1406eb85d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.615063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e15481-fca3-4c1d-be17-edee52441e6b admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.615474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36e6ec-d325-4afe-8655-f1406eb85d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.617571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d36e6ec-d325-4afe-8655-f1406eb85d65 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.631826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e15481-fca3-4c1d-be17-edee52441e6b admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.638416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374ee92-6f4d-466f-a0e0-944fe75b15e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.639313 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374ee92-6f4d-466f-a0e0-944fe75b15e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.641274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374ee92-6f4d-466f-a0e0-944fe75b15e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.641613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374ee92-6f4d-466f-a0e0-944fe75b15e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.642368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374ee92-6f4d-466f-a0e0-944fe75b15e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.643516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1057/2154] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:22.646822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374ee92-6f4d-466f-a0e0-944fe75b15e2 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.647901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36e6ec-d325-4afe-8655-f1406eb85d65 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.667212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d36e6ec-d325-4afe-8655-f1406eb85d65 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.675823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed03946-98ef-40f0-b395-66ad80c030c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.676947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed03946-98ef-40f0-b395-66ad80c030c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.677216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed03946-98ef-40f0-b395-66ad80c030c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.677602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed03946-98ef-40f0-b395-66ad80c030c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.679407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed03946-98ef-40f0-b395-66ad80c030c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.680933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed03946-98ef-40f0-b395-66ad80c030c3 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.689114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1098/2155] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:22 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:22.692930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374ee92-6f4d-466f-a0e0-944fe75b15e2 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.699107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1058/2156] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:22.704812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed03946-98ef-40f0-b395-66ad80c030c3 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.721216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed03946-98ef-40f0-b395-66ad80c030c3 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.794814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374ee92-6f4d-466f-a0e0-944fe75b15e2 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.801209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2406-2009-4ff9-ad11-1c1466a85857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.802086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2406-2009-4ff9-ad11-1c1466a85857 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.802378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2406-2009-4ff9-ad11-1c1466a85857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.802756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b2406-2009-4ff9-ad11-1c1466a85857 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.803500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b2406-2009-4ff9-ad11-1c1466a85857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.805948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb173e-29ea-4ce9-a6c5-9856e8a6891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.806617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207b2406-2009-4ff9-ad11-1c1466a85857 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.806888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb173e-29ea-4ce9-a6c5-9856e8a6891c admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.807316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb173e-29ea-4ce9-a6c5-9856e8a6891c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.807596 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb173e-29ea-4ce9-a6c5-9856e8a6891c admin admin] PATH_INFO: `/v3/projects/3c7791f31da64d4696aa6852e60fd0d8/users/718038cd0446445ca5c972dd6d34083e/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.810162 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:22.830161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb173e-29ea-4ce9-a6c5-9856e8a6891c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c7791f31da64d4696aa6852e60fd0d8, user_id=718038cd0446445ca5c972dd6d34083e, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.833103 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb173e-29ea-4ce9-a6c5-9856e8a6891c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.834571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1099/2157] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:22 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:22.838325 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2406-2009-4ff9-ad11-1c1466a85857 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.863157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b2406-2009-4ff9-ad11-1c1466a85857 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.866546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1059/2158] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:22 2022] PUT /identity/v3/projects/3c7791f31da64d4696aa6852e60fd0d8/users/718038cd0446445ca5c972dd6d34083e/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:22.881287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1112f-9031-437f-ab02-0254a6ff5ca6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.881861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1112f-9031-437f-ab02-0254a6ff5ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.882246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1112f-9031-437f-ab02-0254a6ff5ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.916521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:22.924612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-41b1112f-9031-437f-ab02-0254a6ff5ca6 None None] MFA Rules not processed for user `718038cd0446445ca5c972dd6d34083e`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:22.926579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-41b1112f-9031-437f-ab02-0254a6ff5ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:22.935593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd25237-980b-47ef-baf0-bfff62bf86dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.936795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25237-980b-47ef-baf0-bfff62bf86dc admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.937297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25237-980b-47ef-baf0-bfff62bf86dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.937596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd25237-980b-47ef-baf0-bfff62bf86dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.938356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd25237-980b-47ef-baf0-bfff62bf86dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.942586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd25237-980b-47ef-baf0-bfff62bf86dc admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:22.956696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1100/2159] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:22.961840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd25237-980b-47ef-baf0-bfff62bf86dc admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:22.973903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd25237-980b-47ef-baf0-bfff62bf86dc admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:22.979638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbe1c6-7973-49a7-8a3a-2fe55531ae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:22.980315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe1c6-7973-49a7-8a3a-2fe55531ae19 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:22.980604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe1c6-7973-49a7-8a3a-2fe55531ae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:22.981112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbe1c6-7973-49a7-8a3a-2fe55531ae19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:22.982115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbe1c6-7973-49a7-8a3a-2fe55531ae19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:22.984395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbe1c6-7973-49a7-8a3a-2fe55531ae19 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.000581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1101/2160] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:23.004696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbe1c6-7973-49a7-8a3a-2fe55531ae19 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.013911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1060/2161] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:23.015575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbe1c6-7973-49a7-8a3a-2fe55531ae19 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.020279 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1112f-9031-437f-ab02-0254a6ff5ca6 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.020558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2109fc-81b8-4938-ac79-43b0060abdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.021471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2109fc-81b8-4938-ac79-43b0060abdde admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.021756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2109fc-81b8-4938-ac79-43b0060abdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.022036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2109fc-81b8-4938-ac79-43b0060abdde admin admin] PATH_INFO: `/v3/projects/31a2d15c1a1b4ad28b4ed47345803abc/users/214de666ad6345d2ab69ab9907d18906/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.042054 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1112f-9031-437f-ab02-0254a6ff5ca6 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.042309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2109fc-81b8-4938-ac79-43b0060abdde admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a2d15c1a1b4ad28b4ed47345803abc, user_id=214de666ad6345d2ab69ab9907d18906, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.044402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717e24d-e19c-4885-8dcd-425975eb739a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.044605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2109fc-81b8-4938-ac79-43b0060abdde admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.045070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717e24d-e19c-4885-8dcd-425975eb739a admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.045351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717e24d-e19c-4885-8dcd-425975eb739a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.045697 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717e24d-e19c-4885-8dcd-425975eb739a admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.047257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717e24d-e19c-4885-8dcd-425975eb739a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.049566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717e24d-e19c-4885-8dcd-425975eb739a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.076293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1102/2162] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:23 2022] PUT /identity/v3/projects/31a2d15c1a1b4ad28b4ed47345803abc/users/214de666ad6345d2ab69ab9907d18906/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:23.086918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaa945-8317-4e0e-85d2-f04c20027acd None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.087400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaa945-8317-4e0e-85d2-f04c20027acd None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.087877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaa945-8317-4e0e-85d2-f04c20027acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.090039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1061/2163] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:23 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:23.094331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717e24d-e19c-4885-8dcd-425975eb739a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.132364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1ccaa945-8317-4e0e-85d2-f04c20027acd None None] MFA Rules not processed for user `214de666ad6345d2ab69ab9907d18906`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:23.134558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1ccaa945-8317-4e0e-85d2-f04c20027acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:23.229030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717e24d-e19c-4885-8dcd-425975eb739a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.241921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26738d-7bd2-4823-b1fa-cc7a8c3b6965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.242628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26738d-7bd2-4823-b1fa-cc7a8c3b6965 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.242919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26738d-7bd2-4823-b1fa-cc7a8c3b6965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.243222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26738d-7bd2-4823-b1fa-cc7a8c3b6965 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.243932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26738d-7bd2-4823-b1fa-cc7a8c3b6965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.246274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1103/2164] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:23.249939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26738d-7bd2-4823-b1fa-cc7a8c3b6965 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.250578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaa945-8317-4e0e-85d2-f04c20027acd None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.276216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaa945-8317-4e0e-85d2-f04c20027acd None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.282112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1062/2165] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:23 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:23.286546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f73d-54e8-4022-a6f4-89c2ead91c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.287746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f73d-54e8-4022-a6f4-89c2ead91c0e admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.288302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f73d-54e8-4022-a6f4-89c2ead91c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.288754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b199f73d-54e8-4022-a6f4-89c2ead91c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.289939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f73d-54e8-4022-a6f4-89c2ead91c0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.290540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26738d-7bd2-4823-b1fa-cc7a8c3b6965 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.292062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b199f73d-54e8-4022-a6f4-89c2ead91c0e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.304747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26738d-7bd2-4823-b1fa-cc7a8c3b6965 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.312351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c06faa-9ad0-450b-944b-4404f9323939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.313097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c06faa-9ad0-450b-944b-4404f9323939 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.313391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c06faa-9ad0-450b-944b-4404f9323939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.313688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c06faa-9ad0-450b-944b-4404f9323939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.314430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c06faa-9ad0-450b-944b-4404f9323939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.316082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c06faa-9ad0-450b-944b-4404f9323939 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.335219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1104/2166] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:23 2022] POST /identity/v3/projects => generated 385 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:23.336335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f73d-54e8-4022-a6f4-89c2ead91c0e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.351543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1063/2167] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:23.352604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c06faa-9ad0-450b-944b-4404f9323939 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.380087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c06faa-9ad0-450b-944b-4404f9323939 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.456187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:23.471101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b199f73d-54e8-4022-a6f4-89c2ead91c0e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.477281 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896f0af-008a-477d-93a1-a151aec8d4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.477976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896f0af-008a-477d-93a1-a151aec8d4ad admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.478304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896f0af-008a-477d-93a1-a151aec8d4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.478530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4896f0af-008a-477d-93a1-a151aec8d4ad admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.479568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896f0af-008a-477d-93a1-a151aec8d4ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.489050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4896f0af-008a-477d-93a1-a151aec8d4ad admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.529827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1105/2168] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:23 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:23.537506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896f0af-008a-477d-93a1-a151aec8d4ad admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.543564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301602-369d-446e-bd0c-fb14f16564f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.545377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301602-369d-446e-bd0c-fb14f16564f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.545838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301602-369d-446e-bd0c-fb14f16564f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.546508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25301602-369d-446e-bd0c-fb14f16564f1 admin admin] PATH_INFO: `/v3/projects/dcc12066ff4f4eb2b65bb6db1f5ab256/users/d97dfd66d59d4e78a93fd46da135b3ed/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.552115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:23.562659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4896f0af-008a-477d-93a1-a151aec8d4ad admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.570173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25301602-369d-446e-bd0c-fb14f16564f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc12066ff4f4eb2b65bb6db1f5ab256, user_id=d97dfd66d59d4e78a93fd46da135b3ed, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.580544 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25301602-369d-446e-bd0c-fb14f16564f1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.580642 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7282044-aa53-4ed1-bf04-2e2bc24b1142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.581102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7282044-aa53-4ed1-bf04-2e2bc24b1142 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.581555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7282044-aa53-4ed1-bf04-2e2bc24b1142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.581788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7282044-aa53-4ed1-bf04-2e2bc24b1142 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.582770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7282044-aa53-4ed1-bf04-2e2bc24b1142 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.584331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7282044-aa53-4ed1-bf04-2e2bc24b1142 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.602701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1064/2169] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:23 2022] PUT /identity/v3/projects/dcc12066ff4f4eb2b65bb6db1f5ab256/users/d97dfd66d59d4e78a93fd46da135b3ed/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:23.607932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301602-369d-446e-bd0c-fb14f16564f1 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.623628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1106/2170] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:23.625228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7282044-aa53-4ed1-bf04-2e2bc24b1142 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.653991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7282044-aa53-4ed1-bf04-2e2bc24b1142 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.786727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25301602-369d-446e-bd0c-fb14f16564f1 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.800034 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316778-29c7-4545-8d71-8fa2128aa7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.800733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316778-29c7-4545-8d71-8fa2128aa7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.801017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316778-29c7-4545-8d71-8fa2128aa7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.801290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316778-29c7-4545-8d71-8fa2128aa7b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.803146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316778-29c7-4545-8d71-8fa2128aa7b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.804855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316778-29c7-4545-8d71-8fa2128aa7b8 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.817910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76788e0-a752-4ee1-8733-e7c1e50b5bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.819020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76788e0-a752-4ee1-8733-e7c1e50b5bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.819275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76788e0-a752-4ee1-8733-e7c1e50b5bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.819553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76788e0-a752-4ee1-8733-e7c1e50b5bc3 admin admin] PATH_INFO: `/v3/projects/ab4d3455839b45918af73fdc022cb279/users/143719bbac9447f8aeb534cbedc94228/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.838667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1065/2171] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:23.843590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316778-29c7-4545-8d71-8fa2128aa7b8 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.859222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76788e0-a752-4ee1-8733-e7c1e50b5bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4d3455839b45918af73fdc022cb279, user_id=143719bbac9447f8aeb534cbedc94228, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.861465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76788e0-a752-4ee1-8733-e7c1e50b5bc3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.865027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316778-29c7-4545-8d71-8fa2128aa7b8 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:23.883110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2295b54-c0d2-42cf-a721-8c20d7030c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:23.883308 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295b54-c0d2-42cf-a721-8c20d7030c86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.883580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295b54-c0d2-42cf-a721-8c20d7030c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.883862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2295b54-c0d2-42cf-a721-8c20d7030c86 admin admin] PATH_INFO: `/v3/projects/dcc12066ff4f4eb2b65bb6db1f5ab256/users/d97dfd66d59d4e78a93fd46da135b3ed/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.886250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2295b54-c0d2-42cf-a721-8c20d7030c86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcc12066ff4f4eb2b65bb6db1f5ab256, user_id=d97dfd66d59d4e78a93fd46da135b3ed, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:23.890902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2295b54-c0d2-42cf-a721-8c20d7030c86 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:23.894098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1107/2172] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:23 2022] PUT /identity/v3/projects/ab4d3455839b45918af73fdc022cb279/users/143719bbac9447f8aeb534cbedc94228/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:23.898545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76788e0-a752-4ee1-8733-e7c1e50b5bc3 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:23.908091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1066/2173] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:23 2022] PUT /identity/v3/projects/dcc12066ff4f4eb2b65bb6db1f5ab256/users/d97dfd66d59d4e78a93fd46da135b3ed/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:23.920029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942777e-e6ed-4c4a-8c04-14059706b92a None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:23.920425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942777e-e6ed-4c4a-8c04-14059706b92a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:23.920814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942777e-e6ed-4c4a-8c04-14059706b92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:23.986325 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7942777e-e6ed-4c4a-8c04-14059706b92a None None] MFA Rules not processed for user `d97dfd66d59d4e78a93fd46da135b3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:23.989184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7942777e-e6ed-4c4a-8c04-14059706b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:24.058233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76788e0-a752-4ee1-8733-e7c1e50b5bc3 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:24.130093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1067/2174] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:24.144658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942777e-e6ed-4c4a-8c04-14059706b92a None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:24.147180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7942777e-e6ed-4c4a-8c04-14059706b92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:24.184459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82d0f4-0d08-4133-b8f5-a3eddc042e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:24.187812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d0f4-0d08-4133-b8f5-a3eddc042e64 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:24.187812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d0f4-0d08-4133-b8f5-a3eddc042e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:24.188222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce82d0f4-0d08-4133-b8f5-a3eddc042e64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:24.189905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82d0f4-0d08-4133-b8f5-a3eddc042e64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:24.197234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce82d0f4-0d08-4133-b8f5-a3eddc042e64 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:24.210592 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:24.219817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1108/2175] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:24.224153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82d0f4-0d08-4133-b8f5-a3eddc042e64 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:24.236879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce82d0f4-0d08-4133-b8f5-a3eddc042e64 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:24.242792 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd0de15-8f7d-4f59-b6e7-0aa3baf3e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:24.244059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0de15-8f7d-4f59-b6e7-0aa3baf3e830 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:24.244410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0de15-8f7d-4f59-b6e7-0aa3baf3e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:24.244880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0de15-8f7d-4f59-b6e7-0aa3baf3e830 admin admin] PATH_INFO: `/v3/projects/ab4d3455839b45918af73fdc022cb279/users/143719bbac9447f8aeb534cbedc94228/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:24.247296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0de15-8f7d-4f59-b6e7-0aa3baf3e830 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab4d3455839b45918af73fdc022cb279, user_id=143719bbac9447f8aeb534cbedc94228, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:24.251235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd0de15-8f7d-4f59-b6e7-0aa3baf3e830 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:24.259442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942777e-e6ed-4c4a-8c04-14059706b92a None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:24.264170 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1109/2176] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:24 2022] PUT /identity/v3/projects/ab4d3455839b45918af73fdc022cb279/users/143719bbac9447f8aeb534cbedc94228/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:24.276745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514180cc-7f65-498f-8a27-4666a1b88a3f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:24.277045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514180cc-7f65-498f-8a27-4666a1b88a3f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:24.277332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514180cc-7f65-498f-8a27-4666a1b88a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:24.297814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:24.306851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-514180cc-7f65-498f-8a27-4666a1b88a3f None None] MFA Rules not processed for user `143719bbac9447f8aeb534cbedc94228`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:24.308182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-514180cc-7f65-498f-8a27-4666a1b88a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:24.360520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33232a-f6f3-4856-b258-03a08cb698c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:24.361195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33232a-f6f3-4856-b258-03a08cb698c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:24.361513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33232a-f6f3-4856-b258-03a08cb698c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:24.361839 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33232a-f6f3-4856-b258-03a08cb698c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:24.414352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1110/2177] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:24.452725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33232a-f6f3-4856-b258-03a08cb698c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:24.454209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b33232a-f6f3-4856-b258-03a08cb698c6 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:24.466333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1068/2178] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:24.474789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514180cc-7f65-498f-8a27-4666a1b88a3f None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:24.476342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-514180cc-7f65-498f-8a27-4666a1b88a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:24.490164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514180cc-7f65-498f-8a27-4666a1b88a3f None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:24.497315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9737db3-6feb-4b4f-be60-8ecfdcf12c26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:24.498369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9737db3-6feb-4b4f-be60-8ecfdcf12c26 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:24.498494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9737db3-6feb-4b4f-be60-8ecfdcf12c26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:24.499177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9737db3-6feb-4b4f-be60-8ecfdcf12c26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:24.562888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9737db3-6feb-4b4f-be60-8ecfdcf12c26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:24.564565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9737db3-6feb-4b4f-be60-8ecfdcf12c26 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:24.574311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1111/2179] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:25.726689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33232a-f6f3-4856-b258-03a08cb698c6 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:25.737380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b33232a-f6f3-4856-b258-03a08cb698c6 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:25.741500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f40a39-b1fc-4aa8-9f8c-0cf7ab1e7aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:25.742194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f40a39-b1fc-4aa8-9f8c-0cf7ab1e7aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:25.742479 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f40a39-b1fc-4aa8-9f8c-0cf7ab1e7aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:25.742798 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f40a39-b1fc-4aa8-9f8c-0cf7ab1e7aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:25.744646 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c1f40a39-b1fc-4aa8-9f8c-0cf7ab1e7aa5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:25.823584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f40a39-b1fc-4aa8-9f8c-0cf7ab1e7aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:25.825193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f40a39-b1fc-4aa8-9f8c-0cf7ab1e7aa5 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:25.836899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1069/2180] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:25 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:26.820818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b701-16d9-4d16-bf5d-9ed6032b0625 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:26.821286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b701-16d9-4d16-bf5d-9ed6032b0625 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:26.821379 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7b701-16d9-4d16-bf5d-9ed6032b0625 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:26.822749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1112/2181] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:19:26.838321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208152-3e53-4a98-ac5f-6df5b0c2d763 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:26.838845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208152-3e53-4a98-ac5f-6df5b0c2d763 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:26.839150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92208152-3e53-4a98-ac5f-6df5b0c2d763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:26.860580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-92208152-3e53-4a98-ac5f-6df5b0c2d763 None None] MFA Rules not processed for user `8572e4c550014fc4b1aea3ddf16f7d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:26.862254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-92208152-3e53-4a98-ac5f-6df5b0c2d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:26.903701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b701-16d9-4d16-bf5d-9ed6032b0625 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:26.906939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:26.907398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b1c7b701-16d9-4d16-bf5d-9ed6032b0625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:26.980879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1070/2182] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:19:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:27.005172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92208152-3e53-4a98-ac5f-6df5b0c2d763 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:27.007201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-92208152-3e53-4a98-ac5f-6df5b0c2d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:27.025072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92208152-3e53-4a98-ac5f-6df5b0c2d763 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:27.032859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48278775-2226-4969-9fb2-c9776e7af008 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:27.033519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48278775-2226-4969-9fb2-c9776e7af008 service placement] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.033802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48278775-2226-4969-9fb2-c9776e7af008 service placement] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.034076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48278775-2226-4969-9fb2-c9776e7af008 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.046636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48278775-2226-4969-9fb2-c9776e7af008 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:27.047022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c7b701-16d9-4d16-bf5d-9ed6032b0625 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:27.048629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48278775-2226-4969-9fb2-c9776e7af008 service placement] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:27.055843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:27.065440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.065440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.065440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] PATH_INFO: `/v3/users/eed183b5cd59420da43e87788fd39051` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.065440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed183b5cd59420da43e87788fd39051)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:27.065780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1071/2183] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:27.065869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:27.110515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:27.125514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed183b5cd59420da43e87788fd39051'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:27.126416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed183b5cd59420da43e87788fd39051'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:27.127151 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed183b5cd59420da43e87788fd39051'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:27.135673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed183b5cd59420da43e87788fd39051'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:27.143671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1dea3195-e35a-4f9d-82b3-76dfe06821a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed183b5cd59420da43e87788fd39051'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:27.162874 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1113/2184] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:26 2022] DELETE /identity/v3/users/eed183b5cd59420da43e87788fd39051 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:27.371510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48278775-2226-4969-9fb2-c9776e7af008 service placement] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:27.391956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48278775-2226-4969-9fb2-c9776e7af008 service placement] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:27.459851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:27.460856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.461284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.461683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] PATH_INFO: `/v3/projects/0214c9fd0c94412ab2741d8685bce7ed` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.462928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0214c9fd0c94412ab2741d8685bce7ed)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:27.465005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:27.520711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0214c9fd0c94412ab2741d8685bce7ed', 'request_id': 'req-0e925993-03c9-40f4-bbcc-da6315c04cfb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:27.528361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0214c9fd0c94412ab2741d8685bce7ed', 'request_id': 'req-0e925993-03c9-40f4-bbcc-da6315c04cfb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:27.534208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0214c9fd0c94412ab2741d8685bce7ed', 'request_id': 'req-0e925993-03c9-40f4-bbcc-da6315c04cfb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:27.545440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] The token cache is being invalidate because project 0214c9fd0c94412ab2741d8685bce7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:27.546277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:27.547113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0e925993-03c9-40f4-bbcc-da6315c04cfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:27.548689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1072/2185] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:27 2022] DELETE /identity/v3/projects/0214c9fd0c94412ab2741d8685bce7ed => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:27.554159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3848e5-dc6d-43e6-863d-d9d3f9f280aa None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.554653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3848e5-dc6d-43e6-863d-d9d3f9f280aa None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.555311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3848e5-dc6d-43e6-863d-d9d3f9f280aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.578141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ec3848e5-dc6d-43e6-863d-d9d3f9f280aa None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:27.579410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ec3848e5-dc6d-43e6-863d-d9d3f9f280aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:27.644276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1114/2186] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:27.652768 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53ea86-173e-4388-8570-886705ca1a31 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.653062 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53ea86-173e-4388-8570-886705ca1a31 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.653343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d53ea86-173e-4388-8570-886705ca1a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.673436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7d53ea86-173e-4388-8570-886705ca1a31 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:27.674740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7d53ea86-173e-4388-8570-886705ca1a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:27.682969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1073/2187] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:27.688242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3848e5-dc6d-43e6-863d-d9d3f9f280aa None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:27.698178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3848e5-dc6d-43e6-863d-d9d3f9f280aa None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:27.703223 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83eb63-8b4b-4cf2-ba28-19a7489cc40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:27.704074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83eb63-8b4b-4cf2-ba28-19a7489cc40b admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.704469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83eb63-8b4b-4cf2-ba28-19a7489cc40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.704812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83eb63-8b4b-4cf2-ba28-19a7489cc40b admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.705826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83eb63-8b4b-4cf2-ba28-19a7489cc40b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:27.706261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83eb63-8b4b-4cf2-ba28-19a7489cc40b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:27.708043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83eb63-8b4b-4cf2-ba28-19a7489cc40b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:27.721865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1115/2188] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:19:27.726105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53ea86-173e-4388-8570-886705ca1a31 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:27.737372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d53ea86-173e-4388-8570-886705ca1a31 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:27.742721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b34c29-646b-484f-9a35-6329a620635e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:27.743405 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b34c29-646b-484f-9a35-6329a620635e admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.743690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b34c29-646b-484f-9a35-6329a620635e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.743969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b34c29-646b-484f-9a35-6329a620635e admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.744750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b34c29-646b-484f-9a35-6329a620635e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:27.746923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b34c29-646b-484f-9a35-6329a620635e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:27.774574 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1074/2189] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:27 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:27.778446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83eb63-8b4b-4cf2-ba28-19a7489cc40b admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:27.788792 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83eb63-8b4b-4cf2-ba28-19a7489cc40b admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:27.847994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37398c-ba1b-47dc-acd2-0f9c1ed597ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:27.848670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37398c-ba1b-47dc-acd2-0f9c1ed597ab admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.848958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37398c-ba1b-47dc-acd2-0f9c1ed597ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.849279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff37398c-ba1b-47dc-acd2-0f9c1ed597ab admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.849952 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37398c-ba1b-47dc-acd2-0f9c1ed597ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:27.851990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff37398c-ba1b-47dc-acd2-0f9c1ed597ab admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:27.877639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1116/2190] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:27 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:27.879327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b34c29-646b-484f-9a35-6329a620635e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:27.892091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b34c29-646b-484f-9a35-6329a620635e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:27.898118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e875f3-cbf3-4c20-a05c-a1e1312b763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:27.898826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e875f3-cbf3-4c20-a05c-a1e1312b763b admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.899279 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e875f3-cbf3-4c20-a05c-a1e1312b763b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.899568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e875f3-cbf3-4c20-a05c-a1e1312b763b admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.900325 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e875f3-cbf3-4c20-a05c-a1e1312b763b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:27.901925 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e875f3-cbf3-4c20-a05c-a1e1312b763b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:27.904268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:27.916437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1075/2191] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:27.920093 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37398c-ba1b-47dc-acd2-0f9c1ed597ab admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:27.931239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff37398c-ba1b-47dc-acd2-0f9c1ed597ab admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:27.938932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500e3c84-8721-4793-9b0f-56c857f8e62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:27.939833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e3c84-8721-4793-9b0f-56c857f8e62b admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.940129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e3c84-8721-4793-9b0f-56c857f8e62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.940505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500e3c84-8721-4793-9b0f-56c857f8e62b admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.941474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e3c84-8721-4793-9b0f-56c857f8e62b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:27.943576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500e3c84-8721-4793-9b0f-56c857f8e62b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:27.960645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1117/2192] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:27.961939 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e875f3-cbf3-4c20-a05c-a1e1312b763b admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:27.974282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e875f3-cbf3-4c20-a05c-a1e1312b763b admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:27.979287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c993-9738-43ca-af3f-5ad3a0f8d2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:27.980163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c993-9738-43ca-af3f-5ad3a0f8d2f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:27.980452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c993-9738-43ca-af3f-5ad3a0f8d2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:27.980902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521c993-9738-43ca-af3f-5ad3a0f8d2f4 admin admin] PATH_INFO: `/v3/projects/ebfdd85c68a4421781e66ddbaea93e6b/users/1b6a94234c2d44da86811f825ec21f28/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:27.997016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521c993-9738-43ca-af3f-5ad3a0f8d2f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebfdd85c68a4421781e66ddbaea93e6b, user_id=1b6a94234c2d44da86811f825ec21f28, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:28.000024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b521c993-9738-43ca-af3f-5ad3a0f8d2f4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:28.016246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1076/2193] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:27 2022] PUT /identity/v3/projects/ebfdd85c68a4421781e66ddbaea93e6b/users/1b6a94234c2d44da86811f825ec21f28/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:28.020987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc5dbb-1cd0-4f2f-849d-8c062767115a None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:28.021418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc5dbb-1cd0-4f2f-849d-8c062767115a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:28.021711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc5dbb-1cd0-4f2f-849d-8c062767115a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:28.041670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-56cc5dbb-1cd0-4f2f-849d-8c062767115a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:28.042871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-56cc5dbb-1cd0-4f2f-849d-8c062767115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:28.057725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:28.151767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1118/2194] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:28.163477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c993-9738-43ca-af3f-5ad3a0f8d2f4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:28.173697 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b521c993-9738-43ca-af3f-5ad3a0f8d2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:28.246218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b521c993-9738-43ca-af3f-5ad3a0f8d2f4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:28.250066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5ac78-fb87-4232-b48f-2b43d9f86db4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:28.250708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ac78-fb87-4232-b48f-2b43d9f86db4 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:28.251019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ac78-fb87-4232-b48f-2b43d9f86db4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:28.251296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5ac78-fb87-4232-b48f-2b43d9f86db4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:28.260196 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5ac78-fb87-4232-b48f-2b43d9f86db4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:28.261621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5ac78-fb87-4232-b48f-2b43d9f86db4 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:28.272240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1077/2195] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:29.269906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc5dbb-1cd0-4f2f-849d-8c062767115a None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:29.271681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-56cc5dbb-1cd0-4f2f-849d-8c062767115a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:29.295403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc5dbb-1cd0-4f2f-849d-8c062767115a None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:29.307601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:29.314772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:29.315617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:29.316036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] PATH_INFO: `/v3/users/229d8a6882dc4b61b87028d95d2db1d8` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:29.323694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229d8a6882dc4b61b87028d95d2db1d8)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:29.326529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:29.333039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5ac78-fb87-4232-b48f-2b43d9f86db4 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:29.334406 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-afa5ac78-fb87-4232-b48f-2b43d9f86db4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:29.417948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229d8a6882dc4b61b87028d95d2db1d8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.418818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229d8a6882dc4b61b87028d95d2db1d8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.420111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229d8a6882dc4b61b87028d95d2db1d8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.433507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229d8a6882dc4b61b87028d95d2db1d8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.439497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5ac78-fb87-4232-b48f-2b43d9f86db4 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:29.445645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1050a-7b54-4fab-9e0f-ece629b9e74a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:29.446388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1050a-7b54-4fab-9e0f-ece629b9e74a service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:29.446859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1050a-7b54-4fab-9e0f-ece629b9e74a service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:29.447254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fdca44ba-c986-44f6-9cf2-269543b993f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229d8a6882dc4b61b87028d95d2db1d8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:29.447372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e1050a-7b54-4fab-9e0f-ece629b9e74a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:29.449615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e1e1050a-7b54-4fab-9e0f-ece629b9e74a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:29.496156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1119/2196] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:29 2022] DELETE /identity/v3/users/229d8a6882dc4b61b87028d95d2db1d8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:29.503055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7c5bb-8c0a-46d7-ab37-ba72f14c16ba None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:29.503376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7c5bb-8c0a-46d7-ab37-ba72f14c16ba None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:29.505331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7c5bb-8c0a-46d7-ab37-ba72f14c16ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:29.531430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c4a7c5bb-8c0a-46d7-ab37-ba72f14c16ba None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:29.533331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c4a7c5bb-8c0a-46d7-ab37-ba72f14c16ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:29.548174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1050a-7b54-4fab-9e0f-ece629b9e74a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:29.550337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e1050a-7b54-4fab-9e0f-ece629b9e74a service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:29.571824 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1078/2197] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:29.622326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1120/2198] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:29.635304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1050a-7b54-4fab-9e0f-ece629b9e74a service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:29.637065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e1e1050a-7b54-4fab-9e0f-ece629b9e74a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:29.659902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e1050a-7b54-4fab-9e0f-ece629b9e74a service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:29.732330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:29.791940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f2df7-96b7-4a27-82b6-fe9e780134a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:29.793038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f2df7-96b7-4a27-82b6-fe9e780134a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:29.793809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f2df7-96b7-4a27-82b6-fe9e780134a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:29.794316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f2df7-96b7-4a27-82b6-fe9e780134a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:29.807583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f2df7-96b7-4a27-82b6-fe9e780134a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:29.810056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f2df7-96b7-4a27-82b6-fe9e780134a6 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:29.833255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1079/2199] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:30.363939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7c5bb-8c0a-46d7-ab37-ba72f14c16ba None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:30.365544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c4a7c5bb-8c0a-46d7-ab37-ba72f14c16ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:30.417656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:30.457638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7c5bb-8c0a-46d7-ab37-ba72f14c16ba None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:30.461643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d9183b-6839-4c07-b4a5-9755167ba5fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:30.462362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9183b-6839-4c07-b4a5-9755167ba5fb service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.462648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9183b-6839-4c07-b4a5-9755167ba5fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.462994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d9183b-6839-4c07-b4a5-9755167ba5fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.464808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d8d9183b-6839-4c07-b4a5-9755167ba5fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:30.502634 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f2df7-96b7-4a27-82b6-fe9e780134a6 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:30.504606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2f4f2df7-96b7-4a27-82b6-fe9e780134a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:30.518084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f2df7-96b7-4a27-82b6-fe9e780134a6 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:30.526244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:30.527621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.528918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.529392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] PATH_INFO: `/v3/projects/519642209df049748eabeb622eeb2529` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.532149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=519642209df049748eabeb622eeb2529)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:30.534487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:30.542034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9183b-6839-4c07-b4a5-9755167ba5fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:30.545971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d9183b-6839-4c07-b4a5-9755167ba5fb service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:30.558415 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1121/2200] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:30.625237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519642209df049748eabeb622eeb2529', 'request_id': 'req-3226afbb-b027-4e96-9996-a9af9b810b58'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.634330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519642209df049748eabeb622eeb2529', 'request_id': 'req-3226afbb-b027-4e96-9996-a9af9b810b58'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.642785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519642209df049748eabeb622eeb2529', 'request_id': 'req-3226afbb-b027-4e96-9996-a9af9b810b58'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.667201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] The token cache is being invalidate because project 519642209df049748eabeb622eeb2529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:30.667520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.668217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-3226afbb-b027-4e96-9996-a9af9b810b58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:30.669820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1080/2201] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:30 2022] DELETE /identity/v3/projects/519642209df049748eabeb622eeb2529 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:30.674745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd68e6-6b5c-4da5-a8e3-cdc669746778 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.675091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd68e6-6b5c-4da5-a8e3-cdc669746778 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.675376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdd68e6-6b5c-4da5-a8e3-cdc669746778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.694137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-8bdd68e6-6b5c-4da5-a8e3-cdc669746778 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:30.695623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8bdd68e6-6b5c-4da5-a8e3-cdc669746778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:30.800399 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1122/2202] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:30.809454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2f71-3ca5-48c0-9d58-517f9d255eae None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.809747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2f71-3ca5-48c0-9d58-517f9d255eae None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.810027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a2f71-3ca5-48c0-9d58-517f9d255eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.838832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7e8a2f71-3ca5-48c0-9d58-517f9d255eae None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:30.840296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7e8a2f71-3ca5-48c0-9d58-517f9d255eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:30.851099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1081/2203] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:30.855850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd68e6-6b5c-4da5-a8e3-cdc669746778 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:30.866748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdd68e6-6b5c-4da5-a8e3-cdc669746778 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:30.873363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2775ab3-5249-4e9a-b92b-5a3039888247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:30.874311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2775ab3-5249-4e9a-b92b-5a3039888247 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.875105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2775ab3-5249-4e9a-b92b-5a3039888247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.875603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2775ab3-5249-4e9a-b92b-5a3039888247 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.876556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2775ab3-5249-4e9a-b92b-5a3039888247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:30.877051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2775ab3-5249-4e9a-b92b-5a3039888247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:30.878789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2775ab3-5249-4e9a-b92b-5a3039888247 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:30.897631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1123/2204] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:30.898860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a2f71-3ca5-48c0-9d58-517f9d255eae None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:30.912520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a2f71-3ca5-48c0-9d58-517f9d255eae None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:30.927067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71026-02d8-4732-a12b-348cf7034b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:30.927067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71026-02d8-4732-a12b-348cf7034b4a admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:30.927067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71026-02d8-4732-a12b-348cf7034b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:30.928377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b71026-02d8-4732-a12b-348cf7034b4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:30.929087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b71026-02d8-4732-a12b-348cf7034b4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:30.931074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b71026-02d8-4732-a12b-348cf7034b4a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:30.976722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2775ab3-5249-4e9a-b92b-5a3039888247 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:30.977084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1082/2205] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:30 2022] POST /identity/v3/projects => generated 395 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:31.004710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2775ab3-5249-4e9a-b92b-5a3039888247 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.095201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76aa8f2-bea6-4d68-b866-9ee1503a5058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.097180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aa8f2-bea6-4d68-b866-9ee1503a5058 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.097544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aa8f2-bea6-4d68-b866-9ee1503a5058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.098311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76aa8f2-bea6-4d68-b866-9ee1503a5058 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.099591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76aa8f2-bea6-4d68-b866-9ee1503a5058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.103722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76aa8f2-bea6-4d68-b866-9ee1503a5058 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.135687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:31.152453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1124/2206] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:30 2022] POST /identity/v3/users => generated 298 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:31.153700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71026-02d8-4732-a12b-348cf7034b4a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.166980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b71026-02d8-4732-a12b-348cf7034b4a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.174016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f283d5-f8de-40e6-9234-c6a4898ac6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.174554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f283d5-f8de-40e6-9234-c6a4898ac6bb admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.174845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f283d5-f8de-40e6-9234-c6a4898ac6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.175204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f283d5-f8de-40e6-9234-c6a4898ac6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.176009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f283d5-f8de-40e6-9234-c6a4898ac6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.177999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f283d5-f8de-40e6-9234-c6a4898ac6bb admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.201656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1083/2207] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:31.208833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76aa8f2-bea6-4d68-b866-9ee1503a5058 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.228215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76aa8f2-bea6-4d68-b866-9ee1503a5058 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.245869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38413129-5d36-419c-8196-b22c8ebdd0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.253899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38413129-5d36-419c-8196-b22c8ebdd0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.254249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38413129-5d36-419c-8196-b22c8ebdd0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.254543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38413129-5d36-419c-8196-b22c8ebdd0c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.258500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38413129-5d36-419c-8196-b22c8ebdd0c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.274572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38413129-5d36-419c-8196-b22c8ebdd0c9 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.319155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1125/2208] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:31.323894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f283d5-f8de-40e6-9234-c6a4898ac6bb admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.343181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f283d5-f8de-40e6-9234-c6a4898ac6bb admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.364996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f772f3-3aad-4f78-85c9-6a9fd5555169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.365799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f772f3-3aad-4f78-85c9-6a9fd5555169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.365969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f772f3-3aad-4f78-85c9-6a9fd5555169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.366248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f772f3-3aad-4f78-85c9-6a9fd5555169 admin admin] PATH_INFO: `/v3/projects/af6144863bad447988d4f958c421cb65/users/b6f644fdeafe40f3836397d14bee16ac/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.393100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f772f3-3aad-4f78-85c9-6a9fd5555169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6144863bad447988d4f958c421cb65, user_id=b6f644fdeafe40f3836397d14bee16ac, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.396780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f772f3-3aad-4f78-85c9-6a9fd5555169 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.427060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1084/2209] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:31 2022] PUT /identity/v3/projects/af6144863bad447988d4f958c421cb65/users/b6f644fdeafe40f3836397d14bee16ac/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:31.432594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9c3ec-6656-4666-bdf0-32b028c28edb None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.433057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9c3ec-6656-4666-bdf0-32b028c28edb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.433183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9c3ec-6656-4666-bdf0-32b028c28edb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.476556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e1f9c3ec-6656-4666-bdf0-32b028c28edb None None] MFA Rules not processed for user `b6f644fdeafe40f3836397d14bee16ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:31.478216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e1f9c3ec-6656-4666-bdf0-32b028c28edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:31.613827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1126/2210] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:31.674782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f772f3-3aad-4f78-85c9-6a9fd5555169 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:31.679313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-14f772f3-3aad-4f78-85c9-6a9fd5555169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:31.769552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:31.776633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f772f3-3aad-4f78-85c9-6a9fd5555169 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:31.782339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d1c47-604c-4f7b-bb46-a04d48601837 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:31.783287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d1c47-604c-4f7b-bb46-a04d48601837 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:31.783657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d1c47-604c-4f7b-bb46-a04d48601837 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:31.783945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79d1c47-604c-4f7b-bb46-a04d48601837 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:31.827632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d1c47-604c-4f7b-bb46-a04d48601837 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:31.830285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79d1c47-604c-4f7b-bb46-a04d48601837 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:31.849734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1085/2211] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:33.239486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9c3ec-6656-4666-bdf0-32b028c28edb None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:33.241388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e1f9c3ec-6656-4666-bdf0-32b028c28edb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:33.361963 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9c3ec-6656-4666-bdf0-32b028c28edb None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:33.380188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:33.381661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:33.382191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:33.382721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] PATH_INFO: `/v3/users/4d4a73d6301c49fb8732d1a6dc46a821` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:33.384636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4a73d6301c49fb8732d1a6dc46a821)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:33.387666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:33.474484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4a73d6301c49fb8732d1a6dc46a821'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:33.474657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d1c47-604c-4f7b-bb46-a04d48601837 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:33.476024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4a73d6301c49fb8732d1a6dc46a821'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:33.476318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b79d1c47-604c-4f7b-bb46-a04d48601837 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:33.476961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4a73d6301c49fb8732d1a6dc46a821'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:33.487473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4a73d6301c49fb8732d1a6dc46a821'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:33.503676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-27ccf154-1c3a-4c33-ae89-ccf12706ca0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4a73d6301c49fb8732d1a6dc46a821'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:33.505309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79d1c47-604c-4f7b-bb46-a04d48601837 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:33.513551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:33.514620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:33.514988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:33.515337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] PATH_INFO: `/v3/users/75dc3b57990a47baa31100b2e0911de8` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:33.516682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75dc3b57990a47baa31100b2e0911de8)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:33.520318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:33.535443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:33.544664 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1127/2212] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:33 2022] DELETE /identity/v3/users/4d4a73d6301c49fb8732d1a6dc46a821 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:33.550287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada56ab-53a6-4b7e-95f2-978eb37ded4a None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:33.550737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada56ab-53a6-4b7e-95f2-978eb37ded4a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:33.553050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aada56ab-53a6-4b7e-95f2-978eb37ded4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:33.596278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-aada56ab-53a6-4b7e-95f2-978eb37ded4a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:33.597521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-aada56ab-53a6-4b7e-95f2-978eb37ded4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:33.625416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75dc3b57990a47baa31100b2e0911de8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:33.628794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75dc3b57990a47baa31100b2e0911de8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:33.629880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75dc3b57990a47baa31100b2e0911de8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:33.653000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75dc3b57990a47baa31100b2e0911de8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:33.685092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75dc3b57990a47baa31100b2e0911de8'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:33.720720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1128/2213] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:33.732912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1086/2214] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:33 2022] DELETE /identity/v3/users/75dc3b57990a47baa31100b2e0911de8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:33.738005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0123cd-7569-425d-92f7-d8b74eba5067 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:33.738307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0123cd-7569-425d-92f7-d8b74eba5067 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:33.738591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0123cd-7569-425d-92f7-d8b74eba5067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:33.762157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-8b0123cd-7569-425d-92f7-d8b74eba5067 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:33.763637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8b0123cd-7569-425d-92f7-d8b74eba5067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:33.769235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:33.771086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:33.947028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1129/2215] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:33.955830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0123cd-7569-425d-92f7-d8b74eba5067 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:33.963459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8057b-fa80-4b3c-a5d5-1e36f85b7f58 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:33.970576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0123cd-7569-425d-92f7-d8b74eba5067 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:33.974251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8256a12c-bb70-4e87-b1b3-1e1cd1f62a9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:33.974977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a12c-bb70-4e87-b1b3-1e1cd1f62a9d service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:33.975262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a12c-bb70-4e87-b1b3-1e1cd1f62a9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:33.975661 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8256a12c-bb70-4e87-b1b3-1e1cd1f62a9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:33.981538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6c5a-cc9e-4751-bd67-ee80619df1a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:33.984586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6c5a-cc9e-4751-bd67-ee80619df1a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:33.985599 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6c5a-cc9e-4751-bd67-ee80619df1a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:33.985962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c6c5a-cc9e-4751-bd67-ee80619df1a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:34.003746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256a12c-bb70-4e87-b1b3-1e1cd1f62a9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:34.005236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8256a12c-bb70-4e87-b1b3-1e1cd1f62a9d service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:34.009250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c6c5a-cc9e-4751-bd67-ee80619df1a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:34.011487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c6c5a-cc9e-4751-bd67-ee80619df1a9 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:34.020012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1087/2216] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:34.024100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1130/2217] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:34.175215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2870b-c358-4856-8df9-614fa2c8650f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:34.175903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2870b-c358-4856-8df9-614fa2c8650f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:34.176401 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2870b-c358-4856-8df9-614fa2c8650f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:34.213516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-b8d2870b-c358-4856-8df9-614fa2c8650f None None] MFA Rules not processed for user `1b6a94234c2d44da86811f825ec21f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:34.216266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b8d2870b-c358-4856-8df9-614fa2c8650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:34.309631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:34.322755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1088/2218] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:34.350540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6c5a-cc9e-4751-bd67-ee80619df1a9 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:34.352513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1c6c6c5a-cc9e-4751-bd67-ee80619df1a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:34.531429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c6c5a-cc9e-4751-bd67-ee80619df1a9 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:34.539909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e0f5b-7d4e-47cd-bbd7-e40d4a5ccb4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:34.541425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e0f5b-7d4e-47cd-bbd7-e40d4a5ccb4e service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:34.541719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e0f5b-7d4e-47cd-bbd7-e40d4a5ccb4e service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:34.542078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e0f5b-7d4e-47cd-bbd7-e40d4a5ccb4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:34.564558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e0f5b-7d4e-47cd-bbd7-e40d4a5ccb4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:34.566573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e0f5b-7d4e-47cd-bbd7-e40d4a5ccb4e service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:34.579184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1131/2219] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:34 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:34.614534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2870b-c358-4856-8df9-614fa2c8650f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:34.616256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b8d2870b-c358-4856-8df9-614fa2c8650f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:34.642641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2870b-c358-4856-8df9-614fa2c8650f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:34.661222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:34.662714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:34.663706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:34.663987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] PATH_INFO: `/v3/projects/d2ae18a90946454b9c1189c4a1dd4345` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:34.665387 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2ae18a90946454b9c1189c4a1dd4345)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:34.668240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:34.740207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e0f5b-7d4e-47cd-bbd7-e40d4a5ccb4e service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:34.750332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ed2e0f5b-7d4e-47cd-bbd7-e40d4a5ccb4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:34.789653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e0f5b-7d4e-47cd-bbd7-e40d4a5ccb4e service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:34.807819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:34.840017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2ae18a90946454b9c1189c4a1dd4345', 'request_id': 'req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:34.860720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2ae18a90946454b9c1189c4a1dd4345', 'request_id': 'req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:34.868381 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2ae18a90946454b9c1189c4a1dd4345', 'request_id': 'req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:34.885626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] The token cache is being invalidate because project d2ae18a90946454b9c1189c4a1dd4345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:34.886247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:34.887464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-d697fdaf-e75b-4efb-a41b-565f7fc6b8b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:34.902893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:34.902893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:34.902893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:34.902893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] PATH_INFO: `/v3/projects/8484053a65b94b809c3556df8a8eb761` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:34.903873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8484053a65b94b809c3556df8a8eb761)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:34.903873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:34.907210 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1089/2220] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:34 2022] DELETE /identity/v3/projects/d2ae18a90946454b9c1189c4a1dd4345 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:34.913301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c8c2-e26a-480f-8c6d-eae2a8ecc02a None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:34.913774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c8c2-e26a-480f-8c6d-eae2a8ecc02a None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:34.914219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c8c2-e26a-480f-8c6d-eae2a8ecc02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:34.953990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-79f1c8c2-e26a-480f-8c6d-eae2a8ecc02a None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:34.955647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-79f1c8c2-e26a-480f-8c6d-eae2a8ecc02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:34.987209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1090/2221] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:34.988937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e5dc1-7ed2-4b76-80c1-9f9c065922d9 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:34.989286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8484053a65b94b809c3556df8a8eb761', 'request_id': 'req-8f409701-b280-4fcd-8130-4cb1ce6f2d84'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:34.989915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e5dc1-7ed2-4b76-80c1-9f9c065922d9 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:34.990397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e5dc1-7ed2-4b76-80c1-9f9c065922d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:35.002409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8484053a65b94b809c3556df8a8eb761', 'request_id': 'req-8f409701-b280-4fcd-8130-4cb1ce6f2d84'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.019929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8484053a65b94b809c3556df8a8eb761', 'request_id': 'req-8f409701-b280-4fcd-8130-4cb1ce6f2d84'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.031414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d98e5dc1-7ed2-4b76-80c1-9f9c065922d9 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:35.032638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d98e5dc1-7ed2-4b76-80c1-9f9c065922d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:35.064750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] The token cache is being invalidate because project 8484053a65b94b809c3556df8a8eb761 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:35.065077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.067839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.069355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1132/2222] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:34 2022] DELETE /identity/v3/projects/8484053a65b94b809c3556df8a8eb761 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:35.073517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:35.081363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:35.142552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1091/2223] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:35.146409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e5dc1-7ed2-4b76-80c1-9f9c065922d9 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:35.160391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e5dc1-7ed2-4b76-80c1-9f9c065922d9 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:35.173241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f409701-b280-4fcd-8130-4cb1ce6f2d84 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:35.174533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6cbb4-971e-4b41-978c-0e51892db8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:35.175340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6cbb4-971e-4b41-978c-0e51892db8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:35.175595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6cbb4-971e-4b41-978c-0e51892db8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:35.176009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe6cbb4-971e-4b41-978c-0e51892db8c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:35.176824 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6cbb4-971e-4b41-978c-0e51892db8c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:35.177164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6cbb4-971e-4b41-978c-0e51892db8c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:35.179243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe6cbb4-971e-4b41-978c-0e51892db8c0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:35.182355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:35.183765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:35.184156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:35.184562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] PATH_INFO: `/v3/users/718038cd0446445ca5c972dd6d34083e` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:35.187708 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] RBAC: Authorizing `identity:delete_user(user_id=718038cd0446445ca5c972dd6d34083e)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:35.192481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:35.217783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1092/2224] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:19:35.219329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6cbb4-971e-4b41-978c-0e51892db8c0 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:35.251701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe6cbb4-971e-4b41-978c-0e51892db8c0 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:35.264883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f60d1b-619e-48af-aa22-f8673bcc5bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:35.265650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f60d1b-619e-48af-aa22-f8673bcc5bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:35.266077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f60d1b-619e-48af-aa22-f8673bcc5bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:35.268125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f60d1b-619e-48af-aa22-f8673bcc5bc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:35.271117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:35.274717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f60d1b-619e-48af-aa22-f8673bcc5bc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:35.275069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '718038cd0446445ca5c972dd6d34083e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.275933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '718038cd0446445ca5c972dd6d34083e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.277317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '718038cd0446445ca5c972dd6d34083e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.277799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f60d1b-619e-48af-aa22-f8673bcc5bc9 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:35.289742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '718038cd0446445ca5c972dd6d34083e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.301154 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '718038cd0446445ca5c972dd6d34083e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.321566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1093/2225] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:35 2022] POST /identity/v3/projects => generated 375 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:35.326481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f60d1b-619e-48af-aa22-f8673bcc5bc9 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:35.328650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-55f60d1b-619e-48af-aa22-f8673bcc5bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:35.331457 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1133/2226] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:35 2022] DELETE /identity/v3/users/718038cd0446445ca5c972dd6d34083e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:35.396829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:35.449600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f60d1b-619e-48af-aa22-f8673bcc5bc9 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:35.559529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dec8e-0826-4306-8dfc-f5976547c696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:35.563371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dec8e-0826-4306-8dfc-f5976547c696 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:35.563678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dec8e-0826-4306-8dfc-f5976547c696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:35.563944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275dec8e-0826-4306-8dfc-f5976547c696 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:35.564805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dec8e-0826-4306-8dfc-f5976547c696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:35.567600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275dec8e-0826-4306-8dfc-f5976547c696 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:35.601564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:35.603787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:35.618439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1094/2227] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:35 2022] POST /identity/v3/users => generated 288 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:35.621907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f43db6-0858-40f9-acd3-61183272241f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:35.623757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dec8e-0826-4306-8dfc-f5976547c696 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:35.628437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:35.629334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:35.629621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:35.630307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] PATH_INFO: `/v3/users/214de666ad6345d2ab69ab9907d18906` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:35.633272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=214de666ad6345d2ab69ab9907d18906)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:35.645619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275dec8e-0826-4306-8dfc-f5976547c696 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:35.650499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:35.667026 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3f7eb-16ae-467a-a787-64dffbdfc043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:35.670932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3f7eb-16ae-467a-a787-64dffbdfc043 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:35.671460 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3f7eb-16ae-467a-a787-64dffbdfc043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:35.671966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f3f7eb-16ae-467a-a787-64dffbdfc043 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:35.675727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3f7eb-16ae-467a-a787-64dffbdfc043 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:35.682121 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f3f7eb-16ae-467a-a787-64dffbdfc043 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:35.705796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1095/2228] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:35.710083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3f7eb-16ae-467a-a787-64dffbdfc043 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:35.729482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f3f7eb-16ae-467a-a787-64dffbdfc043 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:35.742397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e00a77-c895-4899-8a39-1c6e3f9141f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:35.743157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e00a77-c895-4899-8a39-1c6e3f9141f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:35.743451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e00a77-c895-4899-8a39-1c6e3f9141f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:35.743735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e00a77-c895-4899-8a39-1c6e3f9141f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:35.744503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e00a77-c895-4899-8a39-1c6e3f9141f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:35.746193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e00a77-c895-4899-8a39-1c6e3f9141f6 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:35.747477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '214de666ad6345d2ab69ab9907d18906'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.749386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '214de666ad6345d2ab69ab9907d18906'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.750828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '214de666ad6345d2ab69ab9907d18906'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.765902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '214de666ad6345d2ab69ab9907d18906'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.773324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1096/2229] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:35.778637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e00a77-c895-4899-8a39-1c6e3f9141f6 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:35.779719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b060a955-9967-4246-83a6-d9e45f9fdb44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '214de666ad6345d2ab69ab9907d18906'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:35.785558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f6e00a77-c895-4899-8a39-1c6e3f9141f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:35.807388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e00a77-c895-4899-8a39-1c6e3f9141f6 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:35.817946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a6c95-ef2d-44a4-9e20-8404bfd504bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:35.820200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a6c95-ef2d-44a4-9e20-8404bfd504bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:35.820616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a6c95-ef2d-44a4-9e20-8404bfd504bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:35.823609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1134/2230] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:35 2022] DELETE /identity/v3/users/214de666ad6345d2ab69ab9907d18906 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:35.823694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a6c95-ef2d-44a4-9e20-8404bfd504bc admin admin] PATH_INFO: `/v3/projects/2b67e7ebcfca48e58e1e2709b67a8b3b/users/e88a1faaaa7b428f880eefc79e22c5cb/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:35.833283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab83e-f761-4904-bcd1-46043a7b9cec None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:35.834745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab83e-f761-4904-bcd1-46043a7b9cec None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:35.835181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cab83e-f761-4904-bcd1-46043a7b9cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:35.864412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c3cab83e-f761-4904-bcd1-46043a7b9cec None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:35.864412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c3cab83e-f761-4904-bcd1-46043a7b9cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:35.879910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a6c95-ef2d-44a4-9e20-8404bfd504bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b67e7ebcfca48e58e1e2709b67a8b3b, user_id=e88a1faaaa7b428f880eefc79e22c5cb, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:35.882605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741a6c95-ef2d-44a4-9e20-8404bfd504bc admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:35.931280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1097/2231] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:35 2022] PUT /identity/v3/projects/2b67e7ebcfca48e58e1e2709b67a8b3b/users/e88a1faaaa7b428f880eefc79e22c5cb/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:35.931280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a6c95-ef2d-44a4-9e20-8404bfd504bc admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:35.936818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-741a6c95-ef2d-44a4-9e20-8404bfd504bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:36.004842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1135/2232] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:36.004842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb98fab-57bd-4d7f-945a-9507bdb1ffc7 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.004842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb98fab-57bd-4d7f-945a-9507bdb1ffc7 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.004842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb98fab-57bd-4d7f-945a-9507bdb1ffc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.042203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a6c95-ef2d-44a4-9e20-8404bfd504bc admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:36.048466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:36.049378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.049661 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.050749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] PATH_INFO: `/v3/projects/3c7791f31da64d4696aa6852e60fd0d8` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.050996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ceb98fab-57bd-4d7f-945a-9507bdb1ffc7 None None] MFA Rules not processed for user `e88a1faaaa7b428f880eefc79e22c5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:36.051889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ceb98fab-57bd-4d7f-945a-9507bdb1ffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:36.052584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c7791f31da64d4696aa6852e60fd0d8)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:36.054918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:36.076440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:36.102886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:36.125764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c7791f31da64d4696aa6852e60fd0d8', 'request_id': 'req-2fc68006-c1e4-46d6-92eb-efb6db75f05d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:36.140310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c7791f31da64d4696aa6852e60fd0d8', 'request_id': 'req-2fc68006-c1e4-46d6-92eb-efb6db75f05d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:36.153174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c7791f31da64d4696aa6852e60fd0d8', 'request_id': 'req-2fc68006-c1e4-46d6-92eb-efb6db75f05d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:36.157043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1136/2233] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:36.159737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb98fab-57bd-4d7f-945a-9507bdb1ffc7 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:36.161719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ceb98fab-57bd-4d7f-945a-9507bdb1ffc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:36.187705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] The token cache is being invalidate because project 3c7791f31da64d4696aa6852e60fd0d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:36.188028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:36.188785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:36.190403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1098/2234] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:35 2022] DELETE /identity/v3/projects/3c7791f31da64d4696aa6852e60fd0d8 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:36.191255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:36.192621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:36.285712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc68006-c1e4-46d6-92eb-efb6db75f05d admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:36.287835 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb98fab-57bd-4d7f-945a-9507bdb1ffc7 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:36.296402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e064b9-a940-4feb-8409-bcf5ba52c308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:36.297081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e064b9-a940-4feb-8409-bcf5ba52c308 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.298624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e064b9-a940-4feb-8409-bcf5ba52c308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.299028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e064b9-a940-4feb-8409-bcf5ba52c308 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.299952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e064b9-a940-4feb-8409-bcf5ba52c308 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:36.305749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e064b9-a940-4feb-8409-bcf5ba52c308 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:36.383935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1099/2235] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:36 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:36.385189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e064b9-a940-4feb-8409-bcf5ba52c308 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:36.388799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d3e064b9-a940-4feb-8409-bcf5ba52c308 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:36.432265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2ab1c-b89a-4c7f-ae1a-b4ca9bf0d023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:36.432935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ab1c-b89a-4c7f-ae1a-b4ca9bf0d023 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.433385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ab1c-b89a-4c7f-ae1a-b4ca9bf0d023 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.433679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ab1c-b89a-4c7f-ae1a-b4ca9bf0d023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.435917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ddd2ab1c-b89a-4c7f-ae1a-b4ca9bf0d023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:36.450820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2ab1c-b89a-4c7f-ae1a-b4ca9bf0d023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:36.453389 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2ab1c-b89a-4c7f-ae1a-b4ca9bf0d023 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:36.484827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1137/2236] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:36.488374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2ab1c-b89a-4c7f-ae1a-b4ca9bf0d023 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:36.495723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e064b9-a940-4feb-8409-bcf5ba52c308 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:36.505159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:36.506275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.506640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.507013 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] PATH_INFO: `/v3/users/d97dfd66d59d4e78a93fd46da135b3ed` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.509329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97dfd66d59d4e78a93fd46da135b3ed)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:36.511436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:36.511868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2ab1c-b89a-4c7f-ae1a-b4ca9bf0d023 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:36.520388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e709d4-3e1d-4bfa-89d4-2b64cc71cf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:36.521392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e709d4-3e1d-4bfa-89d4-2b64cc71cf3b admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.521941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e709d4-3e1d-4bfa-89d4-2b64cc71cf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.522914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e709d4-3e1d-4bfa-89d4-2b64cc71cf3b admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.523824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e709d4-3e1d-4bfa-89d4-2b64cc71cf3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:36.527412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e709d4-3e1d-4bfa-89d4-2b64cc71cf3b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:36.568440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1138/2237] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:36 2022] POST /identity/v3/users => generated 289 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:36.572707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e709d4-3e1d-4bfa-89d4-2b64cc71cf3b admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:36.593375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:36.593586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e709d4-3e1d-4bfa-89d4-2b64cc71cf3b admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:36.598988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97dfd66d59d4e78a93fd46da135b3ed'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:36.600196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b591d5-aeee-4468-8417-8f7d80797601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:36.600948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b591d5-aeee-4468-8417-8f7d80797601 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.601232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b591d5-aeee-4468-8417-8f7d80797601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.601597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b591d5-aeee-4468-8417-8f7d80797601 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.602293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b591d5-aeee-4468-8417-8f7d80797601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:36.604353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b591d5-aeee-4468-8417-8f7d80797601 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:36.612914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97dfd66d59d4e78a93fd46da135b3ed'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:36.614085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97dfd66d59d4e78a93fd46da135b3ed'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:36.618888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1139/2238] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:36.623386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b591d5-aeee-4468-8417-8f7d80797601 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:36.626083 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-67b591d5-aeee-4468-8417-8f7d80797601 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:36.628515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97dfd66d59d4e78a93fd46da135b3ed'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:36.647904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b591d5-aeee-4468-8417-8f7d80797601 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:36.648850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4776fdae-a20a-49ee-b344-63472fa74ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97dfd66d59d4e78a93fd46da135b3ed'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:36.666184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71f19f-c12b-43dd-981b-b400a30b5867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:36.666871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71f19f-c12b-43dd-981b-b400a30b5867 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.667823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71f19f-c12b-43dd-981b-b400a30b5867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.668118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71f19f-c12b-43dd-981b-b400a30b5867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.669854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71f19f-c12b-43dd-981b-b400a30b5867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:36.673105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71f19f-c12b-43dd-981b-b400a30b5867 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:36.689666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1140/2239] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:36.693643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71f19f-c12b-43dd-981b-b400a30b5867 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:36.704621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1100/2240] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:36 2022] DELETE /identity/v3/users/d97dfd66d59d4e78a93fd46da135b3ed => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:36.709407 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71f19f-c12b-43dd-981b-b400a30b5867 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:36.780301 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:36.822341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da2098-e59f-4153-b9c3-6c4c30e04aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:36.823256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da2098-e59f-4153-b9c3-6c4c30e04aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.823565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da2098-e59f-4153-b9c3-6c4c30e04aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.823831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da2098-e59f-4153-b9c3-6c4c30e04aa0 admin admin] PATH_INFO: `/v3/projects/4cd659ad89724dd3bc66d2131cb30644/users/d8ca99a05f8f4b7596174e2609263096/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.841387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da2098-e59f-4153-b9c3-6c4c30e04aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd659ad89724dd3bc66d2131cb30644, user_id=d8ca99a05f8f4b7596174e2609263096, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:36.845415 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da2098-e59f-4153-b9c3-6c4c30e04aa0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:36.881057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1141/2241] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:36 2022] PUT /identity/v3/projects/4cd659ad89724dd3bc66d2131cb30644/users/d8ca99a05f8f4b7596174e2609263096/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:36.895140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ef9f6-7006-487b-aeff-a668539461e0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:36.895463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ef9f6-7006-487b-aeff-a668539461e0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:36.895984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ef9f6-7006-487b-aeff-a668539461e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:36.971612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e91ef9f6-7006-487b-aeff-a668539461e0 None None] MFA Rules not processed for user `d8ca99a05f8f4b7596174e2609263096`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:36.973375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e91ef9f6-7006-487b-aeff-a668539461e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:37.010235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dab44-c463-46a3-a6c4-945625288607 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:37.010527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dab44-c463-46a3-a6c4-945625288607 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:37.010802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93dab44-c463-46a3-a6c4-945625288607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:37.033459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d93dab44-c463-46a3-a6c4-945625288607 None None] MFA Rules not processed for user `1b6a94234c2d44da86811f825ec21f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:37.039857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d93dab44-c463-46a3-a6c4-945625288607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:37.127473 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1101/2242] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:37.129589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ef9f6-7006-487b-aeff-a668539461e0 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:37.132684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e91ef9f6-7006-487b-aeff-a668539461e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:37.187285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1142/2243] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:37 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:37.187285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dab44-c463-46a3-a6c4-945625288607 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:37.300344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93dab44-c463-46a3-a6c4-945625288607 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:37.305765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574b755-39d7-41de-b670-64f4a9e08dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:37.306650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574b755-39d7-41de-b670-64f4a9e08dda admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:37.307036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574b755-39d7-41de-b670-64f4a9e08dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:37.307481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574b755-39d7-41de-b670-64f4a9e08dda admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:37.308260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574b755-39d7-41de-b670-64f4a9e08dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:37.311530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574b755-39d7-41de-b670-64f4a9e08dda admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:37.339466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ef9f6-7006-487b-aeff-a668539461e0 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:37.348290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:37.349590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:37.349926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:37.350270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] PATH_INFO: `/v3/projects/31a2d15c1a1b4ad28b4ed47345803abc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:37.351853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a2d15c1a1b4ad28b4ed47345803abc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:37.357204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:37.372406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1143/2244] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:37 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:37.372406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574b755-39d7-41de-b670-64f4a9e08dda admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:37.377988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6574b755-39d7-41de-b670-64f4a9e08dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:37.426516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a2d15c1a1b4ad28b4ed47345803abc', 'request_id': 'req-cad0f988-f624-429f-bf2d-3185e813ddd9'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.434075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:37.443658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a2d15c1a1b4ad28b4ed47345803abc', 'request_id': 'req-cad0f988-f624-429f-bf2d-3185e813ddd9'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.455950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a2d15c1a1b4ad28b4ed47345803abc', 'request_id': 'req-cad0f988-f624-429f-bf2d-3185e813ddd9'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.466188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:37.471914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574b755-39d7-41de-b670-64f4a9e08dda admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:37.480481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] The token cache is being invalidate because project 31a2d15c1a1b4ad28b4ed47345803abc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:37.480770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.483493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.485445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1102/2245] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:37 2022] DELETE /identity/v3/projects/31a2d15c1a1b4ad28b4ed47345803abc => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:37.485979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:37.489818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:37.616567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0f988-f624-429f-bf2d-3185e813ddd9 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:37.624522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddc6bc-cdc0-47ac-9be5-1ecba2793085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:37.625895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddc6bc-cdc0-47ac-9be5-1ecba2793085 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:37.626182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddc6bc-cdc0-47ac-9be5-1ecba2793085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:37.626459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ddc6bc-cdc0-47ac-9be5-1ecba2793085 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:37.627792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddc6bc-cdc0-47ac-9be5-1ecba2793085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:37.630291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ddc6bc-cdc0-47ac-9be5-1ecba2793085 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:37.675183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:37.676182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:37.676448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:37.676751 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] PATH_INFO: `/v3/projects/dcc12066ff4f4eb2b65bb6db1f5ab256` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:37.678258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcc12066ff4f4eb2b65bb6db1f5ab256)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:37.680490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1103/2246] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:37 2022] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:37.682998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddc6bc-cdc0-47ac-9be5-1ecba2793085 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:37.684643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:37.687662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e3ddc6bc-cdc0-47ac-9be5-1ecba2793085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:37.703734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ddc6bc-cdc0-47ac-9be5-1ecba2793085 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:37.710517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:37.711667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:37.712147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:37.712528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] PATH_INFO: `/v3/users/143719bbac9447f8aeb534cbedc94228` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:37.714277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=143719bbac9447f8aeb534cbedc94228)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:37.716518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:37.784016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcc12066ff4f4eb2b65bb6db1f5ab256', 'request_id': 'req-6b920b45-d7fc-408d-8e4c-cec402cbf572'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.802214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcc12066ff4f4eb2b65bb6db1f5ab256', 'request_id': 'req-6b920b45-d7fc-408d-8e4c-cec402cbf572'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.812661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcc12066ff4f4eb2b65bb6db1f5ab256', 'request_id': 'req-6b920b45-d7fc-408d-8e4c-cec402cbf572'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.824783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '143719bbac9447f8aeb534cbedc94228'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.825504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '143719bbac9447f8aeb534cbedc94228'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.826214 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '143719bbac9447f8aeb534cbedc94228'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.834704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '143719bbac9447f8aeb534cbedc94228'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.847464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] The token cache is being invalidate because project dcc12066ff4f4eb2b65bb6db1f5ab256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:37.847812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.848676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.850534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1144/2247] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:37 2022] DELETE /identity/v3/projects/dcc12066ff4f4eb2b65bb6db1f5ab256 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:37.857413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:37.859438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:37.862309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '143719bbac9447f8aeb534cbedc94228'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:37.897997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1104/2248] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:37 2022] DELETE /identity/v3/users/143719bbac9447f8aeb534cbedc94228 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:37.899247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:37.901236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:37.982224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b920b45-d7fc-408d-8e4c-cec402cbf572 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:37.995694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:38.042229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92141edd-a844-40f6-b717-04213df186b4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:38.057588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6fc110-525e-4284-be2a-2fe9a088e0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:38.058868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fc110-525e-4284-be2a-2fe9a088e0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.059638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fc110-525e-4284-be2a-2fe9a088e0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.069841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6fc110-525e-4284-be2a-2fe9a088e0c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.072646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:38.073717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fc110-525e-4284-be2a-2fe9a088e0c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:38.081990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6fc110-525e-4284-be2a-2fe9a088e0c4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:38.102765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:38.105720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.105720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.105720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] PATH_INFO: `/v3/users/b6f644fdeafe40f3836397d14bee16ac` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.106853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6f644fdeafe40f3836397d14bee16ac)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:38.109719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:38.118943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1105/2249] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:38.121141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14094-61ad-4630-b34a-fb23a2560e4c None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.121474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14094-61ad-4630-b34a-fb23a2560e4c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.121848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d14094-61ad-4630-b34a-fb23a2560e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.167821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c1d14094-61ad-4630-b34a-fb23a2560e4c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:38.169632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c1d14094-61ad-4630-b34a-fb23a2560e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.191388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1106/2250] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:38.192757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d14094-61ad-4630-b34a-fb23a2560e4c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:38.194124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c1d14094-61ad-4630-b34a-fb23a2560e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.217635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d14094-61ad-4630-b34a-fb23a2560e4c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:38.221051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6f644fdeafe40f3836397d14bee16ac'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.222586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6f644fdeafe40f3836397d14bee16ac'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.223526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6f644fdeafe40f3836397d14bee16ac'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.225268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4db52-93b1-4583-a69a-45d5444c2090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:38.226880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4db52-93b1-4583-a69a-45d5444c2090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.227339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4db52-93b1-4583-a69a-45d5444c2090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.227766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4db52-93b1-4583-a69a-45d5444c2090 admin admin] PATH_INFO: `/v3/projects/ad0e6549d251457f90db33f9a43d5cfe/users/e26cda3179d748a8b71a54fffcdb6bfe/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.234579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6f644fdeafe40f3836397d14bee16ac'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.244352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6f644fdeafe40f3836397d14bee16ac'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.249632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4db52-93b1-4583-a69a-45d5444c2090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0e6549d251457f90db33f9a43d5cfe, user_id=e26cda3179d748a8b71a54fffcdb6bfe, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:38.252771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f4db52-93b1-4583-a69a-45d5444c2090 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:38.278673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1107/2251] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:38 2022] PUT /identity/v3/projects/ad0e6549d251457f90db33f9a43d5cfe/users/e26cda3179d748a8b71a54fffcdb6bfe/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:38.281605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cb3f2-871b-475d-8d9e-6e15bd9f5bb2 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.281896 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cb3f2-871b-475d-8d9e-6e15bd9f5bb2 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.283495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cb3f2-871b-475d-8d9e-6e15bd9f5bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.300469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1145/2252] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:37 2022] DELETE /identity/v3/users/b6f644fdeafe40f3836397d14bee16ac => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:38.301444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:38.304729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.334692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-767cb3f2-871b-475d-8d9e-6e15bd9f5bb2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:38.335970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-767cb3f2-871b-475d-8d9e-6e15bd9f5bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.430216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1108/2253] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:38.434505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a0dee-3b4f-4ca4-9454-50443b9ee929 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.434687 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a0dee-3b4f-4ca4-9454-50443b9ee929 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.434993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a0dee-3b4f-4ca4-9454-50443b9ee929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.439543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913586a-8a90-46bb-bcb4-b6a35554149a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:38.453818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2a7f4-37a9-40c4-82c2-d9a4d1e480eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:38.454721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2a7f4-37a9-40c4-82c2-d9a4d1e480eb admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.455242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2a7f4-37a9-40c4-82c2-d9a4d1e480eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.456007 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2a7f4-37a9-40c4-82c2-d9a4d1e480eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.456521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2a7f4-37a9-40c4-82c2-d9a4d1e480eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:38.458347 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2a7f4-37a9-40c4-82c2-d9a4d1e480eb admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:38.460745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-738a0dee-3b4f-4ca4-9454-50443b9ee929 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:38.462240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-738a0dee-3b4f-4ca4-9454-50443b9ee929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.472972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1109/2254] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:38.474148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a0dee-3b4f-4ca4-9454-50443b9ee929 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:38.487819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a0dee-3b4f-4ca4-9454-50443b9ee929 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:38.496790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63e1be-989f-4e54-b22c-2ad9cd5cae50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:38.497532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63e1be-989f-4e54-b22c-2ad9cd5cae50 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.498691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63e1be-989f-4e54-b22c-2ad9cd5cae50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.499132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63e1be-989f-4e54-b22c-2ad9cd5cae50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.499896 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63e1be-989f-4e54-b22c-2ad9cd5cae50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:38.500213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63e1be-989f-4e54-b22c-2ad9cd5cae50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:38.502278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63e1be-989f-4e54-b22c-2ad9cd5cae50 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:38.504102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1146/2255] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:38 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:38.506375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2a7f4-37a9-40c4-82c2-d9a4d1e480eb admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:38.516098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-5cd2a7f4-37a9-40c4-82c2-d9a4d1e480eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.553437 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1110/2256] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:38.554553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63e1be-989f-4e54-b22c-2ad9cd5cae50 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:38.558937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7e63e1be-989f-4e54-b22c-2ad9cd5cae50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.586059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63e1be-989f-4e54-b22c-2ad9cd5cae50 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:38.604669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:38.606155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.606455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.606731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] PATH_INFO: `/v3/projects/ab4d3455839b45918af73fdc022cb279` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.608669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab4d3455839b45918af73fdc022cb279)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:38.610734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:38.621356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2a7f4-37a9-40c4-82c2-d9a4d1e480eb admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:38.625701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9b4b4-dcb6-44f1-905a-e83968a25134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:38.626435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b4b4-dcb6-44f1-905a-e83968a25134 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.626843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b4b4-dcb6-44f1-905a-e83968a25134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.627184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9b4b4-dcb6-44f1-905a-e83968a25134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.640846 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9b4b4-dcb6-44f1-905a-e83968a25134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:38.642365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9b4b4-dcb6-44f1-905a-e83968a25134 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:38.648298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:38.671110 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1147/2257] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:38.672311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9b4b4-dcb6-44f1-905a-e83968a25134 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:38.696135 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9b4b4-dcb6-44f1-905a-e83968a25134 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:38.712137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab4d3455839b45918af73fdc022cb279', 'request_id': 'req-e148aa00-2ad9-4e18-b406-61299761edd0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.732525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab4d3455839b45918af73fdc022cb279', 'request_id': 'req-e148aa00-2ad9-4e18-b406-61299761edd0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.744962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab4d3455839b45918af73fdc022cb279', 'request_id': 'req-e148aa00-2ad9-4e18-b406-61299761edd0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.774941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] The token cache is being invalidate because project ab4d3455839b45918af73fdc022cb279 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:38.776692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.777827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:38.784735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1111/2258] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:38 2022] DELETE /identity/v3/projects/ab4d3455839b45918af73fdc022cb279 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:38.784735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:38.784735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:38.805554 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:38.811667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d3e386-fd1d-49e2-9910-b2267827304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:38.812491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3e386-fd1d-49e2-9910-b2267827304e admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.812780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3e386-fd1d-49e2-9910-b2267827304e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.813066 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d3e386-fd1d-49e2-9910-b2267827304e admin admin] PATH_INFO: `/v3/projects/ad0e6549d251457f90db33f9a43d5cfe/users/e26cda3179d748a8b71a54fffcdb6bfe/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.818995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3e386-fd1d-49e2-9910-b2267827304e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad0e6549d251457f90db33f9a43d5cfe, user_id=e26cda3179d748a8b71a54fffcdb6bfe, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:38.823436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d3e386-fd1d-49e2-9910-b2267827304e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:38.857756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1148/2259] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:38 2022] PUT /identity/v3/projects/ad0e6549d251457f90db33f9a43d5cfe/users/e26cda3179d748a8b71a54fffcdb6bfe/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:38.871404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787ffd-720a-4e6f-adeb-bf0f042c63c9 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:38.871618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787ffd-720a-4e6f-adeb-bf0f042c63c9 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:38.871904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33787ffd-720a-4e6f-adeb-bf0f042c63c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:38.903522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148aa00-2ad9-4e18-b406-61299761edd0 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:38.931864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-33787ffd-720a-4e6f-adeb-bf0f042c63c9 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:38.936676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-33787ffd-720a-4e6f-adeb-bf0f042c63c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.086350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c4555-24d9-4f89-a76f-35ea6edf0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:39.090275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c4555-24d9-4f89-a76f-35ea6edf0015 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.090902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c4555-24d9-4f89-a76f-35ea6edf0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.091701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c4555-24d9-4f89-a76f-35ea6edf0015 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.093760 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c4555-24d9-4f89-a76f-35ea6edf0015 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:39.101578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c4555-24d9-4f89-a76f-35ea6edf0015 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:39.108375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1149/2260] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:39.110669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c028df-558f-4978-ba7a-685b29cd91cd None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.110837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c028df-558f-4978-ba7a-685b29cd91cd None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.111570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c028df-558f-4978-ba7a-685b29cd91cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.169093 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-32c028df-558f-4978-ba7a-685b29cd91cd None None] MFA Rules not processed for user `e26cda3179d748a8b71a54fffcdb6bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:39.171101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-32c028df-558f-4978-ba7a-685b29cd91cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.195469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1112/2261] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:38 2022] POST /identity/v3/projects => generated 371 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:39.198255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5715-8c3d-48ff-b8d5-f6a8f9dd73ba None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.199299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5715-8c3d-48ff-b8d5-f6a8f9dd73ba None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.200411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb5715-8c3d-48ff-b8d5-f6a8f9dd73ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.270699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-bdcb5715-8c3d-48ff-b8d5-f6a8f9dd73ba None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:39.273032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bdcb5715-8c3d-48ff-b8d5-f6a8f9dd73ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.367303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1150/2262] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:39.369226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c028df-558f-4978-ba7a-685b29cd91cd None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:39.395519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c028df-558f-4978-ba7a-685b29cd91cd None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:39.434232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:39.438938 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1113/2263] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:39.442769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5715-8c3d-48ff-b8d5-f6a8f9dd73ba None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:39.450774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bdcb5715-8c3d-48ff-b8d5-f6a8f9dd73ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.494501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb5715-8c3d-48ff-b8d5-f6a8f9dd73ba None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:39.514883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:39.516123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.516507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.517114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] PATH_INFO: `/v3/projects/af6144863bad447988d4f958c421cb65` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.518682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6144863bad447988d4f958c421cb65)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:39.521565 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:39.544190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebee9a-561b-46e9-a676-11906fdaad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:39.545590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebee9a-561b-46e9-a676-11906fdaad1d admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.545945 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebee9a-561b-46e9-a676-11906fdaad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.548417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebee9a-561b-46e9-a676-11906fdaad1d admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.549228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebee9a-561b-46e9-a676-11906fdaad1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:39.559000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ebee9a-561b-46e9-a676-11906fdaad1d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:39.582622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:39.590722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6144863bad447988d4f958c421cb65', 'request_id': 'req-6dc262dc-742c-4018-95d9-f19dacc891e4'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.611502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6144863bad447988d4f958c421cb65', 'request_id': 'req-6dc262dc-742c-4018-95d9-f19dacc891e4'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.623394 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6144863bad447988d4f958c421cb65', 'request_id': 'req-6dc262dc-742c-4018-95d9-f19dacc891e4'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.626871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1151/2264] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:39 2022] POST /identity/v3/users => generated 286 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:39.626871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebee9a-561b-46e9-a676-11906fdaad1d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:39.629171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-59ebee9a-561b-46e9-a676-11906fdaad1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.640837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] The token cache is being invalidate because project af6144863bad447988d4f958c421cb65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:39.641139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.641856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:39.657695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1114/2265] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:39 2022] DELETE /identity/v3/projects/af6144863bad447988d4f958c421cb65 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:39.659231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:39.673607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.768366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebee9a-561b-46e9-a676-11906fdaad1d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:39.885669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc262dc-742c-4018-95d9-f19dacc891e4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:39.893369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0928d15-c2bd-4cf8-8f7e-a93cdd3603f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:39.894157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0928d15-c2bd-4cf8-8f7e-a93cdd3603f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.894543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0928d15-c2bd-4cf8-8f7e-a93cdd3603f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.894918 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0928d15-c2bd-4cf8-8f7e-a93cdd3603f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.895867 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0928d15-c2bd-4cf8-8f7e-a93cdd3603f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:39.896266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0928d15-c2bd-4cf8-8f7e-a93cdd3603f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:39.898041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0928d15-c2bd-4cf8-8f7e-a93cdd3603f6 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:39.909276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a3ba-3db0-41c6-b90b-4ab5f31d7713 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:39.910261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a3ba-3db0-41c6-b90b-4ab5f31d7713 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.910744 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a3ba-3db0-41c6-b90b-4ab5f31d7713 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.911358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf2a3ba-3db0-41c6-b90b-4ab5f31d7713 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.912349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1115/2266] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:39.913832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0928d15-c2bd-4cf8-8f7e-a93cdd3603f6 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:39.916342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d0928d15-c2bd-4cf8-8f7e-a93cdd3603f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.916650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fbf2a3ba-3db0-41c6-b90b-4ab5f31d7713 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:39.936796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0928d15-c2bd-4cf8-8f7e-a93cdd3603f6 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:39.948204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948c06d-0a2f-41c8-9737-9882884c1200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:39.950670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948c06d-0a2f-41c8-9737-9882884c1200 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:39.952261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948c06d-0a2f-41c8-9737-9882884c1200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:39.952621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9948c06d-0a2f-41c8-9737-9882884c1200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:39.953469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948c06d-0a2f-41c8-9737-9882884c1200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:39.956980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9948c06d-0a2f-41c8-9737-9882884c1200 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:39.980409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1116/2267] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:39.981426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948c06d-0a2f-41c8-9737-9882884c1200 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:39.995317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9948c06d-0a2f-41c8-9737-9882884c1200 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.001735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853892-ba51-47a5-9e37-1cd1c0fb4e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.002459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853892-ba51-47a5-9e37-1cd1c0fb4e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.003534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853892-ba51-47a5-9e37-1cd1c0fb4e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.003829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60853892-ba51-47a5-9e37-1cd1c0fb4e11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.004895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60853892-ba51-47a5-9e37-1cd1c0fb4e11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.005893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2a3ba-3db0-41c6-b90b-4ab5f31d7713 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.007064 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60853892-ba51-47a5-9e37-1cd1c0fb4e11 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.010792 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf2a3ba-3db0-41c6-b90b-4ab5f31d7713 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.026889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1152/2268] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:40.028016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a3ba-3db0-41c6-b90b-4ab5f31d7713 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.066737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1117/2269] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:39 2022] POST /identity/v3/projects => generated 359 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:40.070732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853892-ba51-47a5-9e37-1cd1c0fb4e11 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.072681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf2a3ba-3db0-41c6-b90b-4ab5f31d7713 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.105460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:40.170699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60853892-ba51-47a5-9e37-1cd1c0fb4e11 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.177226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b416d1-f18c-43f2-ab30-da0f220546e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.178062 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b416d1-f18c-43f2-ab30-da0f220546e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.178493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b416d1-f18c-43f2-ab30-da0f220546e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.178914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b416d1-f18c-43f2-ab30-da0f220546e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.180804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b416d1-f18c-43f2-ab30-da0f220546e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.183435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b416d1-f18c-43f2-ab30-da0f220546e7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.194651 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b081ad-c35a-4aa3-8222-b6183bf8fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.195402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b081ad-c35a-4aa3-8222-b6183bf8fde2 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.195741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b081ad-c35a-4aa3-8222-b6183bf8fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.196077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b081ad-c35a-4aa3-8222-b6183bf8fde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.197021 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b081ad-c35a-4aa3-8222-b6183bf8fde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.198912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b081ad-c35a-4aa3-8222-b6183bf8fde2 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.223669 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1153/2270] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:40.223860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1118/2271] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:40 2022] POST /identity/v3/users => generated 280 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:40.224956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b416d1-f18c-43f2-ab30-da0f220546e7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.225146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b081ad-c35a-4aa3-8222-b6183bf8fde2 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.238338 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b081ad-c35a-4aa3-8222-b6183bf8fde2 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.244256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7057-7aa9-462b-b34d-cca141d7aeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.244945 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7057-7aa9-462b-b34d-cca141d7aeca admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.245227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7057-7aa9-462b-b34d-cca141d7aeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.245510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d7057-7aa9-462b-b34d-cca141d7aeca admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.246349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d7057-7aa9-462b-b34d-cca141d7aeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.248781 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d7057-7aa9-462b-b34d-cca141d7aeca admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.261260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b416d1-f18c-43f2-ab30-da0f220546e7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.275715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1154/2272] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:40.276833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7057-7aa9-462b-b34d-cca141d7aeca admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.280506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925b088-2e6c-44c4-8e09-1f4216c5c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.284336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925b088-2e6c-44c4-8e09-1f4216c5c323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.284884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925b088-2e6c-44c4-8e09-1f4216c5c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.286260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925b088-2e6c-44c4-8e09-1f4216c5c323 admin admin] PATH_INFO: `/v3/projects/560238e058794e9fa9d065cd1b34a2e5/users/e4b102f48d884d61a57a0d65c2b0f521/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.304354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d7057-7aa9-462b-b34d-cca141d7aeca admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.330521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925b088-2e6c-44c4-8e09-1f4216c5c323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560238e058794e9fa9d065cd1b34a2e5, user_id=e4b102f48d884d61a57a0d65c2b0f521, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.331843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baeea4-c0eb-4989-a8c3-9a39ec9ca5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.332598 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baeea4-c0eb-4989-a8c3-9a39ec9ca5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.332892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baeea4-c0eb-4989-a8c3-9a39ec9ca5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.333178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32baeea4-c0eb-4989-a8c3-9a39ec9ca5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.333949 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baeea4-c0eb-4989-a8c3-9a39ec9ca5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.335777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32baeea4-c0eb-4989-a8c3-9a39ec9ca5a9 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.337261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925b088-2e6c-44c4-8e09-1f4216c5c323 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.342184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:40.355204 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1155/2273] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:40.360471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baeea4-c0eb-4989-a8c3-9a39ec9ca5a9 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.370582 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1119/2274] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:40 2022] PUT /identity/v3/projects/560238e058794e9fa9d065cd1b34a2e5/users/e4b102f48d884d61a57a0d65c2b0f521/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:40.376752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32baeea4-c0eb-4989-a8c3-9a39ec9ca5a9 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.383894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5b62e-e7c5-40ba-aca0-e27d109c460f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.383894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5b62e-e7c5-40ba-aca0-e27d109c460f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.384353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf5b62e-e7c5-40ba-aca0-e27d109c460f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.433794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-0cf5b62e-e7c5-40ba-aca0-e27d109c460f None None] MFA Rules not processed for user `e4b102f48d884d61a57a0d65c2b0f521`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:40.436570 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0cf5b62e-e7c5-40ba-aca0-e27d109c460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:40.509013 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfbf2c-38ff-4388-9fdf-f12f8eeb5bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.511315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfbf2c-38ff-4388-9fdf-f12f8eeb5bc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.511315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfbf2c-38ff-4388-9fdf-f12f8eeb5bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.511315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfbf2c-38ff-4388-9fdf-f12f8eeb5bc6 admin admin] PATH_INFO: `/v3/projects/5af04865a3d04b97b7e43c0162b31e2f/users/c38baebc4b9a43c08cdd435bc8ad387d/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.553980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1120/2275] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:40.574367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5b62e-e7c5-40ba-aca0-e27d109c460f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.574569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfbf2c-38ff-4388-9fdf-f12f8eeb5bc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5af04865a3d04b97b7e43c0162b31e2f, user_id=c38baebc4b9a43c08cdd435bc8ad387d, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.578025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfbf2c-38ff-4388-9fdf-f12f8eeb5bc6 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.578995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0cf5b62e-e7c5-40ba-aca0-e27d109c460f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:40.633466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1156/2276] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:40 2022] PUT /identity/v3/projects/5af04865a3d04b97b7e43c0162b31e2f/users/c38baebc4b9a43c08cdd435bc8ad387d/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:40.635494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f45d9-768a-443e-b1b3-1d9e6cf6d73f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.635797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f45d9-768a-443e-b1b3-1d9e6cf6d73f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.636084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f45d9-768a-443e-b1b3-1d9e6cf6d73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.695587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e64f45d9-768a-443e-b1b3-1d9e6cf6d73f None None] MFA Rules not processed for user `c38baebc4b9a43c08cdd435bc8ad387d`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:40.697045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e64f45d9-768a-443e-b1b3-1d9e6cf6d73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:40.716974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf5b62e-e7c5-40ba-aca0-e27d109c460f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.816386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16227c-78cf-4c86-923b-075380583e93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.817531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16227c-78cf-4c86-923b-075380583e93 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.818009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16227c-78cf-4c86-923b-075380583e93 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.818476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a16227c-78cf-4c86-923b-075380583e93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.821184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1157/2277] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:40 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:40.864856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f45d9-768a-443e-b1b3-1d9e6cf6d73f None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.866750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e64f45d9-768a-443e-b1b3-1d9e6cf6d73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:40.877144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:40.881656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f45d9-768a-443e-b1b3-1d9e6cf6d73f None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:40.890784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221824c-152d-4acd-ab23-d328c74dc577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:40.891498 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221824c-152d-4acd-ab23-d328c74dc577 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:40.893404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221824c-152d-4acd-ab23-d328c74dc577 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:40.893878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3221824c-152d-4acd-ab23-d328c74dc577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:40.908562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221824c-152d-4acd-ab23-d328c74dc577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.910509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3221824c-152d-4acd-ab23-d328c74dc577 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.932318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:40.933071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1158/2278] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:40 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:40.941938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221824c-152d-4acd-ab23-d328c74dc577 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:40.942167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16227c-78cf-4c86-923b-075380583e93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:40.944131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a16227c-78cf-4c86-923b-075380583e93 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:40.965641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1121/2279] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:40.987482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16227c-78cf-4c86-923b-075380583e93 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:41.040614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3221824c-152d-4acd-ab23-d328c74dc577 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.047155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:41.048200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.048731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.049014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] PATH_INFO: `/v3/users/c38baebc4b9a43c08cdd435bc8ad387d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.050268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38baebc4b9a43c08cdd435bc8ad387d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:41.052425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:41.074693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a16227c-78cf-4c86-923b-075380583e93 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.093920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:41.095117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.095583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.096021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] PATH_INFO: `/v3/users/e4b102f48d884d61a57a0d65c2b0f521` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.099193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b102f48d884d61a57a0d65c2b0f521)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:41.101285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:41.123519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38baebc4b9a43c08cdd435bc8ad387d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.124255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38baebc4b9a43c08cdd435bc8ad387d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.124894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38baebc4b9a43c08cdd435bc8ad387d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.134833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38baebc4b9a43c08cdd435bc8ad387d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.146427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1121c117-a030-4930-bed0-dc978bb3df17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38baebc4b9a43c08cdd435bc8ad387d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.171932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b102f48d884d61a57a0d65c2b0f521'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.172602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b102f48d884d61a57a0d65c2b0f521'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.173121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1159/2280] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:40 2022] DELETE /identity/v3/users/c38baebc4b9a43c08cdd435bc8ad387d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:41.173271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b102f48d884d61a57a0d65c2b0f521'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.178398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93681-4293-418f-8517-ca85fea8c839 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.181222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b102f48d884d61a57a0d65c2b0f521'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.181603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93681-4293-418f-8517-ca85fea8c839 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.181976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e93681-4293-418f-8517-ca85fea8c839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.192847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9d30db44-648c-4b8c-88e0-eb8d193b44c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b102f48d884d61a57a0d65c2b0f521'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:41.205294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-84e93681-4293-418f-8517-ca85fea8c839 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:41.206679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-84e93681-4293-418f-8517-ca85fea8c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:41.225420 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1122/2281] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:40 2022] DELETE /identity/v3/users/e4b102f48d884d61a57a0d65c2b0f521 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:41.229754 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad866e70-93fc-499d-9b86-660801d600cb None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.230046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad866e70-93fc-499d-9b86-660801d600cb None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.230334 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad866e70-93fc-499d-9b86-660801d600cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.251121 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-ad866e70-93fc-499d-9b86-660801d600cb None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:41.252551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ad866e70-93fc-499d-9b86-660801d600cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:41.291509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1160/2282] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:41.301906 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e93681-4293-418f-8517-ca85fea8c839 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:41.303971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-84e93681-4293-418f-8517-ca85fea8c839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:41.321659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:41.381185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1123/2283] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:41.388875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e93681-4293-418f-8517-ca85fea8c839 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.392149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad866e70-93fc-499d-9b86-660801d600cb None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:41.444515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:41.485562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b80145-243e-46b3-a5de-7928b5956133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:41.486855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b80145-243e-46b3-a5de-7928b5956133 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.486855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b80145-243e-46b3-a5de-7928b5956133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.486855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b80145-243e-46b3-a5de-7928b5956133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.505800 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b80145-243e-46b3-a5de-7928b5956133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:41.505800 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b80145-243e-46b3-a5de-7928b5956133 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:41.520536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1161/2284] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:41.547465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad866e70-93fc-499d-9b86-660801d600cb None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:41.553549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc470-177b-4e05-bb20-1ad4f7c579fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:41.554328 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc470-177b-4e05-bb20-1ad4f7c579fd service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:41.554744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc470-177b-4e05-bb20-1ad4f7c579fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:41.555061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790fc470-177b-4e05-bb20-1ad4f7c579fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:41.568117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fc470-177b-4e05-bb20-1ad4f7c579fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:41.569856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790fc470-177b-4e05-bb20-1ad4f7c579fd service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:41.586674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1124/2285] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:41.933129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b80145-243e-46b3-a5de-7928b5956133 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:41.934690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c3b80145-243e-46b3-a5de-7928b5956133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.005372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b80145-243e-46b3-a5de-7928b5956133 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.009358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c798f1-6f8c-474f-8657-578eab96eed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.010491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c798f1-6f8c-474f-8657-578eab96eed7 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.010611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c798f1-6f8c-474f-8657-578eab96eed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.010890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c798f1-6f8c-474f-8657-578eab96eed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.013887 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-99c798f1-6f8c-474f-8657-578eab96eed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.110058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c798f1-6f8c-474f-8657-578eab96eed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.115423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c798f1-6f8c-474f-8657-578eab96eed7 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.136161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1162/2286] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:42.168723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc470-177b-4e05-bb20-1ad4f7c579fd service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.170940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-790fc470-177b-4e05-bb20-1ad4f7c579fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.192072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790fc470-177b-4e05-bb20-1ad4f7c579fd service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.207208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.208446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.208627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.209280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] PATH_INFO: `/v3/projects/5af04865a3d04b97b7e43c0162b31e2f` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.210676 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5af04865a3d04b97b7e43c0162b31e2f)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.216057 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.267326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c798f1-6f8c-474f-8657-578eab96eed7 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.269355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-99c798f1-6f8c-474f-8657-578eab96eed7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.307504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c798f1-6f8c-474f-8657-578eab96eed7 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.334512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5af04865a3d04b97b7e43c0162b31e2f', 'request_id': 'req-a3a4ef01-6e9f-4873-b94c-944ee57c4113'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:42.351392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5af04865a3d04b97b7e43c0162b31e2f', 'request_id': 'req-a3a4ef01-6e9f-4873-b94c-944ee57c4113'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:42.352630 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:42.363087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5af04865a3d04b97b7e43c0162b31e2f', 'request_id': 'req-a3a4ef01-6e9f-4873-b94c-944ee57c4113'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:42.381659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] The token cache is being invalidate because project 5af04865a3d04b97b7e43c0162b31e2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:42.381941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:42.382714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a3a4ef01-6e9f-4873-b94c-944ee57c4113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:42.384964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1125/2287] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:42 2022] DELETE /identity/v3/projects/5af04865a3d04b97b7e43c0162b31e2f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:42.406379 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.407702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.408081 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.408475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] PATH_INFO: `/v3/projects/560238e058794e9fa9d065cd1b34a2e5` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.412541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] RBAC: Authorizing `identity:delete_project(project_id=560238e058794e9fa9d065cd1b34a2e5)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.414581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.545656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560238e058794e9fa9d065cd1b34a2e5', 'request_id': 'req-5a4de607-f510-4c11-afe2-f3113140e56d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:42.594100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560238e058794e9fa9d065cd1b34a2e5', 'request_id': 'req-5a4de607-f510-4c11-afe2-f3113140e56d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:42.611496 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560238e058794e9fa9d065cd1b34a2e5', 'request_id': 'req-5a4de607-f510-4c11-afe2-f3113140e56d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:42.634127 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] The token cache is being invalidate because project 560238e058794e9fa9d065cd1b34a2e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:42.635352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:42.638835 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5a4de607-f510-4c11-afe2-f3113140e56d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:42.641662 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1163/2288] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:42 2022] DELETE /identity/v3/projects/560238e058794e9fa9d065cd1b34a2e5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:42.647224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f09000-1d83-45b6-bb79-aefcfee3d068 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.647518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f09000-1d83-45b6-bb79-aefcfee3d068 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.658258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f09000-1d83-45b6-bb79-aefcfee3d068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.676961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c2f09000-1d83-45b6-bb79-aefcfee3d068 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:42.678513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c2f09000-1d83-45b6-bb79-aefcfee3d068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.755462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1126/2289] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:42.764405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11554c-6e41-4bfd-bdb0-839c9c2196ef None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.764749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11554c-6e41-4bfd-bdb0-839c9c2196ef None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.765124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11554c-6e41-4bfd-bdb0-839c9c2196ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.796489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-8f11554c-6e41-4bfd-bdb0-839c9c2196ef None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:42.798074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8f11554c-6e41-4bfd-bdb0-839c9c2196ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:42.818094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f09000-1d83-45b6-bb79-aefcfee3d068 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.827270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1164/2290] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:42.832010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f09000-1d83-45b6-bb79-aefcfee3d068 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.852850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be429698-5569-47ba-8603-4ecfff0909ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.853655 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be429698-5569-47ba-8603-4ecfff0909ec admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.853866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be429698-5569-47ba-8603-4ecfff0909ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.854084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be429698-5569-47ba-8603-4ecfff0909ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.854884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be429698-5569-47ba-8603-4ecfff0909ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:42.855183 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be429698-5569-47ba-8603-4ecfff0909ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.857952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be429698-5569-47ba-8603-4ecfff0909ec admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.872071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1127/2291] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:42.877290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11554c-6e41-4bfd-bdb0-839c9c2196ef None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.890018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11554c-6e41-4bfd-bdb0-839c9c2196ef None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.895122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0250462-6ded-405a-8a2d-1466e84cc351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:42.895796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250462-6ded-405a-8a2d-1466e84cc351 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:42.896079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250462-6ded-405a-8a2d-1466e84cc351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:42.896354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0250462-6ded-405a-8a2d-1466e84cc351 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:42.897243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0250462-6ded-405a-8a2d-1466e84cc351 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:42.899212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0250462-6ded-405a-8a2d-1466e84cc351 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:42.930594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1165/2292] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:42 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:42.939673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be429698-5569-47ba-8603-4ecfff0909ec admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:42.952117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be429698-5569-47ba-8603-4ecfff0909ec admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:42.983761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:43.023384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932b299-a886-4129-9d22-9cad11db12d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.024327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932b299-a886-4129-9d22-9cad11db12d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.024577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932b299-a886-4129-9d22-9cad11db12d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.025013 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932b299-a886-4129-9d22-9cad11db12d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.025747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932b299-a886-4129-9d22-9cad11db12d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.027762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0250462-6ded-405a-8a2d-1466e84cc351 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.028200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932b299-a886-4129-9d22-9cad11db12d8 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.030097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a0250462-6ded-405a-8a2d-1466e84cc351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.052840 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1128/2293] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:42 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:43.053903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932b299-a886-4129-9d22-9cad11db12d8 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.068765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932b299-a886-4129-9d22-9cad11db12d8 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.076523 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62751366-9564-4f30-a422-f2a5d99d18a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.077630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751366-9564-4f30-a422-f2a5d99d18a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.078132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751366-9564-4f30-a422-f2a5d99d18a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.078605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62751366-9564-4f30-a422-f2a5d99d18a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.079765 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62751366-9564-4f30-a422-f2a5d99d18a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.081910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62751366-9564-4f30-a422-f2a5d99d18a5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.095099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1129/2294] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:43.097101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0250462-6ded-405a-8a2d-1466e84cc351 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.098882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62751366-9564-4f30-a422-f2a5d99d18a5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.100959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea227226-ee60-431b-90cc-8d82004202c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.101611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea227226-ee60-431b-90cc-8d82004202c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.101895 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea227226-ee60-431b-90cc-8d82004202c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.102173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea227226-ee60-431b-90cc-8d82004202c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.104284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ea227226-ee60-431b-90cc-8d82004202c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.109275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62751366-9564-4f30-a422-f2a5d99d18a5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.114072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243eae5a-bb9c-48e7-b0b5-df104020a795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.114722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243eae5a-bb9c-48e7-b0b5-df104020a795 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.115032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243eae5a-bb9c-48e7-b0b5-df104020a795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.115309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243eae5a-bb9c-48e7-b0b5-df104020a795 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.116041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243eae5a-bb9c-48e7-b0b5-df104020a795 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.117635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243eae5a-bb9c-48e7-b0b5-df104020a795 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.128540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1130/2295] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:43.132879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243eae5a-bb9c-48e7-b0b5-df104020a795 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.142709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243eae5a-bb9c-48e7-b0b5-df104020a795 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.148547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8ff2e-c3a0-43f5-aa01-eb56ccdbbb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.149459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ff2e-c3a0-43f5-aa01-eb56ccdbbb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.149746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ff2e-c3a0-43f5-aa01-eb56ccdbbb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.150024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8ff2e-c3a0-43f5-aa01-eb56ccdbbb27 admin admin] PATH_INFO: `/v3/projects/97b3aaf4980645498fd893902ba0411b/users/0cf7529b6e0b4599892ffb34e2be807f/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.158129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:43.166755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8ff2e-c3a0-43f5-aa01-eb56ccdbbb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b3aaf4980645498fd893902ba0411b, user_id=0cf7529b6e0b4599892ffb34e2be807f, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.170376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8ff2e-c3a0-43f5-aa01-eb56ccdbbb27 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.183201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1131/2296] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:43 2022] PUT /identity/v3/projects/97b3aaf4980645498fd893902ba0411b/users/0cf7529b6e0b4599892ffb34e2be807f/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:43.183458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea227226-ee60-431b-90cc-8d82004202c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.186048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea227226-ee60-431b-90cc-8d82004202c5 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.197199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1166/2297] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:43.255628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ae8e-5db0-45fe-8e1b-f3bec8bc1c9d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.256012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ae8e-5db0-45fe-8e1b-f3bec8bc1c9d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.256322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96ae8e-5db0-45fe-8e1b-f3bec8bc1c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.290287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-8b96ae8e-5db0-45fe-8e1b-f3bec8bc1c9d None None] MFA Rules not processed for user `0cf7529b6e0b4599892ffb34e2be807f`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:43.291555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8b96ae8e-5db0-45fe-8e1b-f3bec8bc1c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.365723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1132/2298] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:43.370360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea227226-ee60-431b-90cc-8d82004202c5 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.381861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea227226-ee60-431b-90cc-8d82004202c5 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.456870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834887f-20c2-47ce-ad3a-3d30649eb9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.457739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834887f-20c2-47ce-ad3a-3d30649eb9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.458212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834887f-20c2-47ce-ad3a-3d30649eb9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.458576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834887f-20c2-47ce-ad3a-3d30649eb9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.459481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834887f-20c2-47ce-ad3a-3d30649eb9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.461428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834887f-20c2-47ce-ad3a-3d30649eb9e8 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.493378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1167/2299] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:43 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:43.494627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ae8e-5db0-45fe-8e1b-f3bec8bc1c9d None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.506445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96ae8e-5db0-45fe-8e1b-f3bec8bc1c9d None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.565593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e72dc-92d2-4dc5-8463-5e6c58e1eadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.566271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e72dc-92d2-4dc5-8463-5e6c58e1eadd admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.566551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e72dc-92d2-4dc5-8463-5e6c58e1eadd admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.566827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e72dc-92d2-4dc5-8463-5e6c58e1eadd admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.567561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e72dc-92d2-4dc5-8463-5e6c58e1eadd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.569475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e72dc-92d2-4dc5-8463-5e6c58e1eadd admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.578147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:43.595316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1133/2300] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:43 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:43.596564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834887f-20c2-47ce-ad3a-3d30649eb9e8 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.607875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834887f-20c2-47ce-ad3a-3d30649eb9e8 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.612473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a20b0b-13a3-4e5a-9517-ddb915002b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.613137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a20b0b-13a3-4e5a-9517-ddb915002b19 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.613439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a20b0b-13a3-4e5a-9517-ddb915002b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.613697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a20b0b-13a3-4e5a-9517-ddb915002b19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.614428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a20b0b-13a3-4e5a-9517-ddb915002b19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.616058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a20b0b-13a3-4e5a-9517-ddb915002b19 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.628125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1168/2301] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:43.632220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e72dc-92d2-4dc5-8463-5e6c58e1eadd admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.642871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e72dc-92d2-4dc5-8463-5e6c58e1eadd admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.647492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317412a-19e6-4093-8238-8b98bcb9c7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.648367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317412a-19e6-4093-8238-8b98bcb9c7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.648658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317412a-19e6-4093-8238-8b98bcb9c7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.648938 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e317412a-19e6-4093-8238-8b98bcb9c7e7 admin admin] PATH_INFO: `/v3/projects/3848ca1683bc40a5af73188003834b21/users/0fea6f0162514020a442bac23caaf420/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.664952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317412a-19e6-4093-8238-8b98bcb9c7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3848ca1683bc40a5af73188003834b21, user_id=0fea6f0162514020a442bac23caaf420, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.667671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e317412a-19e6-4093-8238-8b98bcb9c7e7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.681598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1134/2302] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:43 2022] PUT /identity/v3/projects/3848ca1683bc40a5af73188003834b21/users/0fea6f0162514020a442bac23caaf420/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:43.686430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a20b0b-13a3-4e5a-9517-ddb915002b19 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.696448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a20b0b-13a3-4e5a-9517-ddb915002b19 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.753668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808f83cc-e34a-4283-ba92-d173434494ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.754329 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f83cc-e34a-4283-ba92-d173434494ab admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.754608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f83cc-e34a-4283-ba92-d173434494ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.754883 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808f83cc-e34a-4283-ba92-d173434494ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.755645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f83cc-e34a-4283-ba92-d173434494ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.757272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808f83cc-e34a-4283-ba92-d173434494ab admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.767625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1169/2303] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:43.771928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317412a-19e6-4093-8238-8b98bcb9c7e7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.782166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e317412a-19e6-4093-8238-8b98bcb9c7e7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.786748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06542e53-5906-43ab-95ff-b9a55636a3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.787658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06542e53-5906-43ab-95ff-b9a55636a3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.787941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06542e53-5906-43ab-95ff-b9a55636a3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.788212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06542e53-5906-43ab-95ff-b9a55636a3ed admin admin] PATH_INFO: `/v3/projects/3848ca1683bc40a5af73188003834b21/users/0fea6f0162514020a442bac23caaf420/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.790153 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06542e53-5906-43ab-95ff-b9a55636a3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3848ca1683bc40a5af73188003834b21, user_id=0fea6f0162514020a442bac23caaf420, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:43.792833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06542e53-5906-43ab-95ff-b9a55636a3ed admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:43.802767 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1135/2304] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:43 2022] PUT /identity/v3/projects/3848ca1683bc40a5af73188003834b21/users/0fea6f0162514020a442bac23caaf420/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:43.813701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c3fbb-99f1-4187-8315-3ba279c6bdec None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.813988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c3fbb-99f1-4187-8315-3ba279c6bdec None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.814264 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c3fbb-99f1-4187-8315-3ba279c6bdec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:43.840253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-bf3c3fbb-99f1-4187-8315-3ba279c6bdec None None] MFA Rules not processed for user `0fea6f0162514020a442bac23caaf420`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:43.841462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-bf3c3fbb-99f1-4187-8315-3ba279c6bdec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.874309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:43.909826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1170/2305] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:43.921105 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06542e53-5906-43ab-95ff-b9a55636a3ed admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:43.922876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-06542e53-5906-43ab-95ff-b9a55636a3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:43.981033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06542e53-5906-43ab-95ff-b9a55636a3ed admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:43.984836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77c5790-c0ab-4f82-bc65-924a83b98608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:43.985470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5790-c0ab-4f82-bc65-924a83b98608 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:43.985751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5790-c0ab-4f82-bc65-924a83b98608 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:43.986029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77c5790-c0ab-4f82-bc65-924a83b98608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:44.046499 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c5790-c0ab-4f82-bc65-924a83b98608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:44.048004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77c5790-c0ab-4f82-bc65-924a83b98608 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:44.057531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1136/2306] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:46.623504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c3fbb-99f1-4187-8315-3ba279c6bdec None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.687600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c3fbb-99f1-4187-8315-3ba279c6bdec None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.692086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.692948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.693231 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.693504 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] PATH_INFO: `/v3/users/0cf7529b6e0b4599892ffb34e2be807f` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.694684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf7529b6e0b4599892ffb34e2be807f)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.696728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.742975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf7529b6e0b4599892ffb34e2be807f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:46.743637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf7529b6e0b4599892ffb34e2be807f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:46.744262 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf7529b6e0b4599892ffb34e2be807f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:46.751221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf7529b6e0b4599892ffb34e2be807f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:46.758324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf7529b6e0b4599892ffb34e2be807f'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:46.775245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1171/2307] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:46 2022] DELETE /identity/v3/users/0cf7529b6e0b4599892ffb34e2be807f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:46.780560 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0ac9-b2b0-4fac-a845-7a4a7f0d186f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.781014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0ac9-b2b0-4fac-a845-7a4a7f0d186f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.781156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ea0ac9-b2b0-4fac-a845-7a4a7f0d186f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.798377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-a9ea0ac9-b2b0-4fac-a845-7a4a7f0d186f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:46.799618 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a9ea0ac9-b2b0-4fac-a845-7a4a7f0d186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:46.861304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1137/2308] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:46.871025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:46.872455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:46.932380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5cbbc-a409-4997-b751-4953eea61d0f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:46.936793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e59609-2122-4a54-aa4e-8af40d0be2cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:46.937553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59609-2122-4a54-aa4e-8af40d0be2cc service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:46.937829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59609-2122-4a54-aa4e-8af40d0be2cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:46.938112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e59609-2122-4a54-aa4e-8af40d0be2cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:46.945173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:46.951473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e59609-2122-4a54-aa4e-8af40d0be2cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:46.953685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e59609-2122-4a54-aa4e-8af40d0be2cc service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:46.964526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1172/2309] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:47.201234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea0ac9-b2b0-4fac-a845-7a4a7f0d186f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:47.203307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a9ea0ac9-b2b0-4fac-a845-7a4a7f0d186f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:47.225600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ea0ac9-b2b0-4fac-a845-7a4a7f0d186f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:47.232368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:47.233264 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.233551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.234434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] PATH_INFO: `/v3/users/e88a1faaaa7b428f880eefc79e22c5cb` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.235749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e88a1faaaa7b428f880eefc79e22c5cb)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:47.237775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:47.240434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:47.301903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e88a1faaaa7b428f880eefc79e22c5cb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.302577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e88a1faaaa7b428f880eefc79e22c5cb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.303353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e88a1faaaa7b428f880eefc79e22c5cb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.313129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e88a1faaaa7b428f880eefc79e22c5cb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.321130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e88a1faaaa7b428f880eefc79e22c5cb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.339662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1138/2310] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:47 2022] DELETE /identity/v3/users/e88a1faaaa7b428f880eefc79e22c5cb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:47.344169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297fae4-6261-4d73-aa33-24739a9415ba None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.344459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297fae4-6261-4d73-aa33-24739a9415ba None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.344855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297fae4-6261-4d73-aa33-24739a9415ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.365006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-4297fae4-6261-4d73-aa33-24739a9415ba None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:47.366569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4297fae4-6261-4d73-aa33-24739a9415ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:47.417707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:47.419947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:47.460922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1173/2311] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:47.471942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297fae4-6261-4d73-aa33-24739a9415ba None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:47.474022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4297fae4-6261-4d73-aa33-24739a9415ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:47.505991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2667b414-7310-4f30-86b1-766a576de25d admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:47.511187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:47.512155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.512490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.513699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] PATH_INFO: `/v3/projects/97b3aaf4980645498fd893902ba0411b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.514514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b3aaf4980645498fd893902ba0411b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:47.516471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:47.547012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297fae4-6261-4d73-aa33-24739a9415ba None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:47.551211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514213a-b8e0-4208-9b59-6e5c606613e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:47.552089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514213a-b8e0-4208-9b59-6e5c606613e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.552379 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514213a-b8e0-4208-9b59-6e5c606613e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.553105 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514213a-b8e0-4208-9b59-6e5c606613e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.564077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514213a-b8e0-4208-9b59-6e5c606613e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:47.565531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514213a-b8e0-4208-9b59-6e5c606613e7 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:47.573959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b3aaf4980645498fd893902ba0411b', 'request_id': 'req-55a8fa67-e897-4b24-81d5-efdc07660696'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.576925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1174/2312] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:47.583400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b3aaf4980645498fd893902ba0411b', 'request_id': 'req-55a8fa67-e897-4b24-81d5-efdc07660696'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.590094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b3aaf4980645498fd893902ba0411b', 'request_id': 'req-55a8fa67-e897-4b24-81d5-efdc07660696'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.604669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] The token cache is being invalidate because project 97b3aaf4980645498fd893902ba0411b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:47.604971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.606027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.611276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1139/2313] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:47 2022] DELETE /identity/v3/projects/97b3aaf4980645498fd893902ba0411b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:47.612995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514213a-b8e0-4208-9b59-6e5c606613e7 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:47.628325 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514213a-b8e0-4208-9b59-6e5c606613e7 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:47.710530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:47.711538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.712126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.712309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] PATH_INFO: `/v3/users/0fea6f0162514020a442bac23caaf420` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.714743 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fea6f0162514020a442bac23caaf420)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:47.717739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:47.805450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:47.813884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fea6f0162514020a442bac23caaf420'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.814608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fea6f0162514020a442bac23caaf420'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.815666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fea6f0162514020a442bac23caaf420'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.825506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fea6f0162514020a442bac23caaf420'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.833280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fea6f0162514020a442bac23caaf420'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:47.851016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1175/2314] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:47 2022] DELETE /identity/v3/users/0fea6f0162514020a442bac23caaf420 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:47.892164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:47.894163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:47.907609 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a8fa67-e897-4b24-81d5-efdc07660696 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:47.915984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:47.979196 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:47.980182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:47.980540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:47.980888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] PATH_INFO: `/v3/projects/2b67e7ebcfca48e58e1e2709b67a8b3b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:47.982883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b67e7ebcfca48e58e1e2709b67a8b3b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:47.984893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.038317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b67e7ebcfca48e58e1e2709b67a8b3b', 'request_id': 'req-a5d2f06d-d61e-4a5c-9da1-267e994b2588'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.046457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b67e7ebcfca48e58e1e2709b67a8b3b', 'request_id': 'req-a5d2f06d-d61e-4a5c-9da1-267e994b2588'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.052921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b67e7ebcfca48e58e1e2709b67a8b3b', 'request_id': 'req-a5d2f06d-d61e-4a5c-9da1-267e994b2588'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.067947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] The token cache is being invalidate because project 2b67e7ebcfca48e58e1e2709b67a8b3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:48.068242 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.068891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.070558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1140/2315] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:47 2022] DELETE /identity/v3/projects/2b67e7ebcfca48e58e1e2709b67a8b3b => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:48.074638 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.076486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:48.090647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad54e2-89b5-4261-a3e2-65534a48baf1 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.155269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.156202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.156502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.156765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] PATH_INFO: `/v3/users/d8ca99a05f8f4b7596174e2609263096` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.157944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ca99a05f8f4b7596174e2609263096)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.159924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.168714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.170891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:48.185806 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2f06d-d61e-4a5c-9da1-267e994b2588 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.191350 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.192424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.192584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.192995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] PATH_INFO: `/v3/projects/3848ca1683bc40a5af73188003834b21` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.215636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3848ca1683bc40a5af73188003834b21)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.218335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.241681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ca99a05f8f4b7596174e2609263096'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.242469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ca99a05f8f4b7596174e2609263096'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.243750 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ca99a05f8f4b7596174e2609263096'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.252502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ca99a05f8f4b7596174e2609263096'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.261864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-afb6d33e-b0da-4528-a26d-bbc906c6d454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ca99a05f8f4b7596174e2609263096'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.277377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3848ca1683bc40a5af73188003834b21', 'request_id': 'req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.286562 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1176/2316] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:48 2022] DELETE /identity/v3/users/d8ca99a05f8f4b7596174e2609263096 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:48.287313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3848ca1683bc40a5af73188003834b21', 'request_id': 'req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.298683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3848ca1683bc40a5af73188003834b21', 'request_id': 'req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.321677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] The token cache is being invalidate because project 3848ca1683bc40a5af73188003834b21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:48.321978 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.322832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-fbd90e7b-e767-4ad1-a1e1-f5eafab9e3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.326823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1141/2317] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:48 2022] DELETE /identity/v3/projects/3848ca1683bc40a5af73188003834b21 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:48.338382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c59b8-8de2-4818-b2d1-ce708ccbb47f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.338915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c59b8-8de2-4818-b2d1-ce708ccbb47f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.340737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c59b8-8de2-4818-b2d1-ce708ccbb47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.378676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-959c59b8-8de2-4818-b2d1-ce708ccbb47f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:48.380481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-959c59b8-8de2-4818-b2d1-ce708ccbb47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:48.427888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:48.476446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1177/2318] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:48.485031 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5a5f7-02d2-4c11-bdfb-a330d0826e8b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.485322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5a5f7-02d2-4c11-bdfb-a330d0826e8b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.485605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f5a5f7-02d2-4c11-bdfb-a330d0826e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.510206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-58f5a5f7-02d2-4c11-bdfb-a330d0826e8b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:48.511625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-58f5a5f7-02d2-4c11-bdfb-a330d0826e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:48.527273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1142/2319] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:48.528055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c59b8-8de2-4818-b2d1-ce708ccbb47f None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.552380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c59b8-8de2-4818-b2d1-ce708ccbb47f None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.562430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835d92-fac0-42ca-a859-ea0f6a5e6454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.563349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835d92-fac0-42ca-a859-ea0f6a5e6454 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.563637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835d92-fac0-42ca-a859-ea0f6a5e6454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.564315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82835d92-fac0-42ca-a859-ea0f6a5e6454 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.565868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835d92-fac0-42ca-a859-ea0f6a5e6454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:48.566287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835d92-fac0-42ca-a859-ea0f6a5e6454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.568239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82835d92-fac0-42ca-a859-ea0f6a5e6454 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.594807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1178/2320] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:19:48.598776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5a5f7-02d2-4c11-bdfb-a330d0826e8b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.620916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f5a5f7-02d2-4c11-bdfb-a330d0826e8b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.631719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260c97-26e2-42ee-adf2-c40479f52e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.632204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260c97-26e2-42ee-adf2-c40479f52e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.632493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260c97-26e2-42ee-adf2-c40479f52e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.632779 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82260c97-26e2-42ee-adf2-c40479f52e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.633487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82260c97-26e2-42ee-adf2-c40479f52e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.635587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82260c97-26e2-42ee-adf2-c40479f52e77 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.652092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:48.680650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1143/2321] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:48 2022] POST /identity/v3/projects => generated 385 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:48.681779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835d92-fac0-42ca-a859-ea0f6a5e6454 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.696157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82835d92-fac0-42ca-a859-ea0f6a5e6454 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.775835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260c97-26e2-42ee-adf2-c40479f52e77 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.777889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-82260c97-26e2-42ee-adf2-c40479f52e77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:48.795315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59f11b-5bbb-43f9-a623-8b4b5298e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.796413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59f11b-5bbb-43f9-a623-8b4b5298e0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.796773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59f11b-5bbb-43f9-a623-8b4b5298e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.797187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59f11b-5bbb-43f9-a623-8b4b5298e0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.798046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59f11b-5bbb-43f9-a623-8b4b5298e0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.800560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc59f11b-5bbb-43f9-a623-8b4b5298e0a4 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.830656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1179/2322] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:48 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:19:48.834572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59f11b-5bbb-43f9-a623-8b4b5298e0a4 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.846181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59f11b-5bbb-43f9-a623-8b4b5298e0a4 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.853430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56907977-e008-48da-b1b6-fc40d00c9554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.854068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56907977-e008-48da-b1b6-fc40d00c9554 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.854356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56907977-e008-48da-b1b6-fc40d00c9554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.854637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56907977-e008-48da-b1b6-fc40d00c9554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.855653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56907977-e008-48da-b1b6-fc40d00c9554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.857237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56907977-e008-48da-b1b6-fc40d00c9554 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.868513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1180/2323] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:48.872460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56907977-e008-48da-b1b6-fc40d00c9554 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.872735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82260c97-26e2-42ee-adf2-c40479f52e77 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.879069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.879937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.880215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.880479 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] PATH_INFO: `/v3/projects/4cd659ad89724dd3bc66d2131cb30644` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.881672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd659ad89724dd3bc66d2131cb30644)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.882991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56907977-e008-48da-b1b6-fc40d00c9554 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.883741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.888403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0367c-7a47-443b-ba81-f8cbfee3e484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.889297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0367c-7a47-443b-ba81-f8cbfee3e484 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.889602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0367c-7a47-443b-ba81-f8cbfee3e484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.889987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0367c-7a47-443b-ba81-f8cbfee3e484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.890755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0367c-7a47-443b-ba81-f8cbfee3e484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.892696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0367c-7a47-443b-ba81-f8cbfee3e484 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.908534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1181/2324] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:19:48.909590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0367c-7a47-443b-ba81-f8cbfee3e484 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.922433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0367c-7a47-443b-ba81-f8cbfee3e484 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:48.928509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066bfca-0841-40fa-a71c-6b4780eaad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:48.929416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066bfca-0841-40fa-a71c-6b4780eaad98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.929703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066bfca-0841-40fa-a71c-6b4780eaad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.930124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066bfca-0841-40fa-a71c-6b4780eaad98 admin admin] PATH_INFO: `/v3/projects/412a199f464f40f292755dc2b0166dea/users/9154cb9d2f63452ca7be6a085d6d9449/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.946837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd659ad89724dd3bc66d2131cb30644', 'request_id': 'req-23d7bac5-98e9-4858-8674-4a761cb84c96'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.949054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066bfca-0841-40fa-a71c-6b4780eaad98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=412a199f464f40f292755dc2b0166dea, user_id=9154cb9d2f63452ca7be6a085d6d9449, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:48.952169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066bfca-0841-40fa-a71c-6b4780eaad98 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:48.957576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd659ad89724dd3bc66d2131cb30644', 'request_id': 'req-23d7bac5-98e9-4858-8674-4a761cb84c96'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.967965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1182/2325] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:48 2022] PUT /identity/v3/projects/412a199f464f40f292755dc2b0166dea/users/9154cb9d2f63452ca7be6a085d6d9449/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:48.968303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd659ad89724dd3bc66d2131cb30644', 'request_id': 'req-23d7bac5-98e9-4858-8674-4a761cb84c96'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.977866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5985-6ba3-46a5-9709-6b749d645556 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:48.978160 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5985-6ba3-46a5-9709-6b749d645556 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:48.978433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c5985-6ba3-46a5-9709-6b749d645556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:48.984851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] The token cache is being invalidate because project 4cd659ad89724dd3bc66d2131cb30644 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:48.985383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.988058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:48.990389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1144/2326] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:48 2022] DELETE /identity/v3/projects/4cd659ad89724dd3bc66d2131cb30644 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:48.994417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:48.996325 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:49.007730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d99c5985-6ba3-46a5-9709-6b749d645556 None None] MFA Rules not processed for user `9154cb9d2f63452ca7be6a085d6d9449`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:49.009832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d99c5985-6ba3-46a5-9709-6b749d645556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:49.086732 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:49.088651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7bac5-98e9-4858-8674-4a761cb84c96 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:49.100857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1183/2327] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:49.117489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c5985-6ba3-46a5-9709-6b749d645556 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:49.119137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d99c5985-6ba3-46a5-9709-6b749d645556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:49.154835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:49.209177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:49.210488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:49.214033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:49.214525 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] PATH_INFO: `/v3/users/e26cda3179d748a8b71a54fffcdb6bfe` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:49.217817 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e26cda3179d748a8b71a54fffcdb6bfe)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:49.221436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:49.234350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c5985-6ba3-46a5-9709-6b749d645556 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:49.238521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b4e52-6f4f-45c3-802e-049cb034b0b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:49.239339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b4e52-6f4f-45c3-802e-049cb034b0b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:49.240229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b4e52-6f4f-45c3-802e-049cb034b0b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:49.240613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b4e52-6f4f-45c3-802e-049cb034b0b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:49.252163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b4e52-6f4f-45c3-802e-049cb034b0b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:49.254479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b4e52-6f4f-45c3-802e-049cb034b0b9 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:49.266772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1184/2328] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:19:49.290926 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e26cda3179d748a8b71a54fffcdb6bfe'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:49.291928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e26cda3179d748a8b71a54fffcdb6bfe'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:49.292555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e26cda3179d748a8b71a54fffcdb6bfe'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:49.304081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e26cda3179d748a8b71a54fffcdb6bfe'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:49.317809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-614a8285-cb84-4f34-99a6-453d01be6394 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e26cda3179d748a8b71a54fffcdb6bfe'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:49.340025 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1145/2329] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:48 2022] DELETE /identity/v3/users/e26cda3179d748a8b71a54fffcdb6bfe => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:49.822763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b4e52-6f4f-45c3-802e-049cb034b0b9 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:49.836353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b4e52-6f4f-45c3-802e-049cb034b0b9 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:49.938362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:49.939291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:49.939643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:49.940117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] PATH_INFO: `/v3/projects/ad0e6549d251457f90db33f9a43d5cfe` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:49.941519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad0e6549d251457f90db33f9a43d5cfe)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:49.943759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:49.995707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad0e6549d251457f90db33f9a43d5cfe', 'request_id': 'req-027edd66-a668-4728-bf7e-3409fa71de96'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:50.003961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad0e6549d251457f90db33f9a43d5cfe', 'request_id': 'req-027edd66-a668-4728-bf7e-3409fa71de96'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:50.010252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad0e6549d251457f90db33f9a43d5cfe', 'request_id': 'req-027edd66-a668-4728-bf7e-3409fa71de96'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:50.021402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] The token cache is being invalidate because project ad0e6549d251457f90db33f9a43d5cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:50.021686 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:50.022308 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-027edd66-a668-4728-bf7e-3409fa71de96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:50.023889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1185/2330] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:49 2022] DELETE /identity/v3/projects/ad0e6549d251457f90db33f9a43d5cfe => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:50.029493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb21c0-e792-48ae-8ff7-86e0ccd042c3 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.029972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb21c0-e792-48ae-8ff7-86e0ccd042c3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.030124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb21c0-e792-48ae-8ff7-86e0ccd042c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.048436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-86fb21c0-e792-48ae-8ff7-86e0ccd042c3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:50.049621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-86fb21c0-e792-48ae-8ff7-86e0ccd042c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:50.107295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1146/2331] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:50.115259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c940-17e6-4b15-bace-916d1c6c880d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.115553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c940-17e6-4b15-bace-916d1c6c880d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.115834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c0c940-17e6-4b15-bace-916d1c6c880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.134725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-65c0c940-17e6-4b15-bace-916d1c6c880d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:50.135980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-65c0c940-17e6-4b15-bace-916d1c6c880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:50.144526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1186/2332] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:50.148684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb21c0-e792-48ae-8ff7-86e0ccd042c3 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.159004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb21c0-e792-48ae-8ff7-86e0ccd042c3 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.163531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ee0e4-cd59-4de8-8a00-e9d148fccc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.164174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ee0e4-cd59-4de8-8a00-e9d148fccc47 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.164452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ee0e4-cd59-4de8-8a00-e9d148fccc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.164727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ee0e4-cd59-4de8-8a00-e9d148fccc47 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.165443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ee0e4-cd59-4de8-8a00-e9d148fccc47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:50.165747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ee0e4-cd59-4de8-8a00-e9d148fccc47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.167398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ee0e4-cd59-4de8-8a00-e9d148fccc47 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.178885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1147/2333] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:50.184042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0c940-17e6-4b15-bace-916d1c6c880d None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.193962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c0c940-17e6-4b15-bace-916d1c6c880d None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.198581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186600ea-fe59-4708-9fb7-ebc118539083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.199249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186600ea-fe59-4708-9fb7-ebc118539083 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.199531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186600ea-fe59-4708-9fb7-ebc118539083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.199806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186600ea-fe59-4708-9fb7-ebc118539083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.201031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186600ea-fe59-4708-9fb7-ebc118539083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.202972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186600ea-fe59-4708-9fb7-ebc118539083 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.222712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:50.230286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1187/2334] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:50 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:50.235213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ee0e4-cd59-4de8-8a00-e9d148fccc47 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.245857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ee0e4-cd59-4de8-8a00-e9d148fccc47 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.288351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:50.312843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644acf35-1604-4f3e-b53f-e4eb473c599f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.313576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644acf35-1604-4f3e-b53f-e4eb473c599f admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.313864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644acf35-1604-4f3e-b53f-e4eb473c599f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.314185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644acf35-1604-4f3e-b53f-e4eb473c599f admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.314880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644acf35-1604-4f3e-b53f-e4eb473c599f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.316931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644acf35-1604-4f3e-b53f-e4eb473c599f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.340714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1148/2335] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:50 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:50.342407 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186600ea-fe59-4708-9fb7-ebc118539083 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.353036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186600ea-fe59-4708-9fb7-ebc118539083 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.360011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d6ee5-caa5-4ac9-988d-c83e9b0ad036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.360696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d6ee5-caa5-4ac9-988d-c83e9b0ad036 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.360977 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d6ee5-caa5-4ac9-988d-c83e9b0ad036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.361261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d6ee5-caa5-4ac9-988d-c83e9b0ad036 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.362156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d6ee5-caa5-4ac9-988d-c83e9b0ad036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.364031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d6ee5-caa5-4ac9-988d-c83e9b0ad036 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.378271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1188/2336] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:50.382407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644acf35-1604-4f3e-b53f-e4eb473c599f admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.393117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644acf35-1604-4f3e-b53f-e4eb473c599f admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.397931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5124bd6f-3301-48c2-95fb-a69613713e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.398597 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124bd6f-3301-48c2-95fb-a69613713e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.398881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124bd6f-3301-48c2-95fb-a69613713e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.399198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5124bd6f-3301-48c2-95fb-a69613713e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.399932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124bd6f-3301-48c2-95fb-a69613713e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.401548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5124bd6f-3301-48c2-95fb-a69613713e74 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.413287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1149/2337] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:50.417361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d6ee5-caa5-4ac9-988d-c83e9b0ad036 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.427412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d6ee5-caa5-4ac9-988d-c83e9b0ad036 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.432235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056e915-a7a5-41ab-a3c7-017b956078f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.433290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056e915-a7a5-41ab-a3c7-017b956078f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.433602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056e915-a7a5-41ab-a3c7-017b956078f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.433882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9056e915-a7a5-41ab-a3c7-017b956078f2 admin admin] PATH_INFO: `/v3/projects/d89787eb886944db9d241fbf90ebfed0/users/5444c7cab8b24c77b193db0d320bfbf0/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.452413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056e915-a7a5-41ab-a3c7-017b956078f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d89787eb886944db9d241fbf90ebfed0, user_id=5444c7cab8b24c77b193db0d320bfbf0, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.455146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9056e915-a7a5-41ab-a3c7-017b956078f2 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.468358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1189/2338] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:50 2022] PUT /identity/v3/projects/d89787eb886944db9d241fbf90ebfed0/users/5444c7cab8b24c77b193db0d320bfbf0/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:50.480123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e56e0-2274-4198-8b6e-ab742000254b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.480436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e56e0-2274-4198-8b6e-ab742000254b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.480715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e56e0-2274-4198-8b6e-ab742000254b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.507481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-3b3e56e0-2274-4198-8b6e-ab742000254b None None] MFA Rules not processed for user `5444c7cab8b24c77b193db0d320bfbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:50.508824 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3b3e56e0-2274-4198-8b6e-ab742000254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:50.583054 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1150/2339] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:50.594975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056e915-a7a5-41ab-a3c7-017b956078f2 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:50.598617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9056e915-a7a5-41ab-a3c7-017b956078f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:50.678416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9056e915-a7a5-41ab-a3c7-017b956078f2 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:50.682290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32278b47-afc6-4f2c-994c-a1f0e42cf36a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:50.683612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278b47-afc6-4f2c-994c-a1f0e42cf36a service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:50.683924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278b47-afc6-4f2c-994c-a1f0e42cf36a service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:50.684203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32278b47-afc6-4f2c-994c-a1f0e42cf36a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:50.694849 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32278b47-afc6-4f2c-994c-a1f0e42cf36a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:50.696508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32278b47-afc6-4f2c-994c-a1f0e42cf36a service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:50.707471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1190/2340] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:50 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:51.875955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e56e0-2274-4198-8b6e-ab742000254b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:51.877441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3b3e56e0-2274-4198-8b6e-ab742000254b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:51.944147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e56e0-2274-4198-8b6e-ab742000254b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:51.949737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:51.950649 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:51.950934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:51.951248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] PATH_INFO: `/v3/users/9154cb9d2f63452ca7be6a085d6d9449` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:51.952477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9154cb9d2f63452ca7be6a085d6d9449)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:51.954476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:52.000436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9154cb9d2f63452ca7be6a085d6d9449'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:52.001085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9154cb9d2f63452ca7be6a085d6d9449'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:52.001684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9154cb9d2f63452ca7be6a085d6d9449'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:52.003660 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:52.011219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9154cb9d2f63452ca7be6a085d6d9449'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:52.018416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9154cb9d2f63452ca7be6a085d6d9449'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:52.036004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1151/2341] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:51 2022] DELETE /identity/v3/users/9154cb9d2f63452ca7be6a085d6d9449 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:52.040543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637291-6921-4b66-a8a8-4f9b6e1b86b8 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:52.041008 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637291-6921-4b66-a8a8-4f9b6e1b86b8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:52.041133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc637291-6921-4b66-a8a8-4f9b6e1b86b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:52.058220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-dc637291-6921-4b66-a8a8-4f9b6e1b86b8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:52.059462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-dc637291-6921-4b66-a8a8-4f9b6e1b86b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:52.117844 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1191/2342] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:52.128371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:52.130069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:52.173452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5599d5-263f-4c9c-961b-357931fb7244 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:52.173744 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5599d5-263f-4c9c-961b-357931fb7244 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:52.174031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5599d5-263f-4c9c-961b-357931fb7244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:52.199744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9af812a-14a7-4a37-ad9b-dd11982b50cf admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:52.204335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f60381-eb9d-4780-abbd-d93d50b134d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:52.205232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f60381-eb9d-4780-abbd-d93d50b134d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:52.205705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f60381-eb9d-4780-abbd-d93d50b134d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:52.206190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f60381-eb9d-4780-abbd-d93d50b134d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:52.213513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-7d5599d5-263f-4c9c-961b-357931fb7244 None None] MFA Rules not processed for user `5444c7cab8b24c77b193db0d320bfbf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:52.214723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7d5599d5-263f-4c9c-961b-357931fb7244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:52.222112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f60381-eb9d-4780-abbd-d93d50b134d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:52.223804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f60381-eb9d-4780-abbd-d93d50b134d6 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:52.237488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1152/2343] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:52.285031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1192/2344] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:52.602663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f60381-eb9d-4780-abbd-d93d50b134d6 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:52.604201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-26f60381-eb9d-4780-abbd-d93d50b134d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:52.623719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f60381-eb9d-4780-abbd-d93d50b134d6 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:52.631088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:52.631965 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:52.632257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:52.632535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] PATH_INFO: `/v3/projects/412a199f464f40f292755dc2b0166dea` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:52.633800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=412a199f464f40f292755dc2b0166dea)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:52.635945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:52.703881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '412a199f464f40f292755dc2b0166dea', 'request_id': 'req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:52.714877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '412a199f464f40f292755dc2b0166dea', 'request_id': 'req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:52.722356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '412a199f464f40f292755dc2b0166dea', 'request_id': 'req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:52.736942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] The token cache is being invalidate because project 412a199f464f40f292755dc2b0166dea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:52.737236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:52.737914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c2a66153-5b21-4d9e-b0a6-4a9dc8291d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:52.754989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1153/2345] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:52 2022] DELETE /identity/v3/projects/412a199f464f40f292755dc2b0166dea => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:55.698817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5599d5-263f-4c9c-961b-357931fb7244 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:55.701041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7d5599d5-263f-4c9c-961b-357931fb7244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:55.714505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5599d5-263f-4c9c-961b-357931fb7244 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:55.724012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:55.774229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:55.775175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:55.775463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:55.775748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] PATH_INFO: `/v3/users/5d72e0c731224e92a897e82a6c0e6e55` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:55.776965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d72e0c731224e92a897e82a6c0e6e55)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:55.779127 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:55.827271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d72e0c731224e92a897e82a6c0e6e55'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.827917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d72e0c731224e92a897e82a6c0e6e55'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.828517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d72e0c731224e92a897e82a6c0e6e55'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.835459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d72e0c731224e92a897e82a6c0e6e55'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.844711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d72e0c731224e92a897e82a6c0e6e55'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:55.862438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1193/2346] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:19:55 2022] DELETE /identity/v3/users/5d72e0c731224e92a897e82a6c0e6e55 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:55.867285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2861-2f19-43a6-9b32-f176569ddd43 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:55.867800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2861-2f19-43a6-9b32-f176569ddd43 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:55.868036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33c2861-2f19-43a6-9b32-f176569ddd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:55.886863 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c33c2861-2f19-43a6-9b32-f176569ddd43 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:55.888629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c33c2861-2f19-43a6-9b32-f176569ddd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:55.940600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:55.956714 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1154/2347] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:55.967201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:55.968618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:56.049698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b9617-63fd-40d2-bbe0-d371c68595ac admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.053409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54362d0-82cd-494d-b9f8-21f625a9c480 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.054058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54362d0-82cd-494d-b9f8-21f625a9c480 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.054343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54362d0-82cd-494d-b9f8-21f625a9c480 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.054626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54362d0-82cd-494d-b9f8-21f625a9c480 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.064267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54362d0-82cd-494d-b9f8-21f625a9c480 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.065716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54362d0-82cd-494d-b9f8-21f625a9c480 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.075903 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1194/2348] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:56.418668 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2861-2f19-43a6-9b32-f176569ddd43 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.420682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c33c2861-2f19-43a6-9b32-f176569ddd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:56.433009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33c2861-2f19-43a6-9b32-f176569ddd43 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.439247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.440569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.441174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.441727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] PATH_INFO: `/v3/projects/572b6d6eaac4487094e15477930db4a8` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.443349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572b6d6eaac4487094e15477930db4a8)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.445576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.511842 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572b6d6eaac4487094e15477930db4a8', 'request_id': 'req-5423b779-e384-4e68-aefd-7ed35a9e6f49'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:56.520408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572b6d6eaac4487094e15477930db4a8', 'request_id': 'req-5423b779-e384-4e68-aefd-7ed35a9e6f49'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:56.526521 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572b6d6eaac4487094e15477930db4a8', 'request_id': 'req-5423b779-e384-4e68-aefd-7ed35a9e6f49'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:56.539701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] The token cache is being invalidate because project 572b6d6eaac4487094e15477930db4a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:19:56.540032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:56.540777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5423b779-e384-4e68-aefd-7ed35a9e6f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:19:56.542433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1155/2349] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:19:56 2022] DELETE /identity/v3/projects/572b6d6eaac4487094e15477930db4a8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:19:56.548202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8fa67-8a79-49b5-96d4-05ed162791d6 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.548498 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8fa67-8a79-49b5-96d4-05ed162791d6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.548782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba8fa67-8a79-49b5-96d4-05ed162791d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.567900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-0ba8fa67-8a79-49b5-96d4-05ed162791d6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:56.569116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0ba8fa67-8a79-49b5-96d4-05ed162791d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:56.599968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:56.633068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1195/2350] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:56.642128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8851b-65d8-4692-a47e-a29ebd3f3163 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.642424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8851b-65d8-4692-a47e-a29ebd3f3163 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.642712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8851b-65d8-4692-a47e-a29ebd3f3163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.661378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-27d8851b-65d8-4692-a47e-a29ebd3f3163 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:56.662593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-27d8851b-65d8-4692-a47e-a29ebd3f3163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:56.670720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1156/2351] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:56.674921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8fa67-8a79-49b5-96d4-05ed162791d6 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.685667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba8fa67-8a79-49b5-96d4-05ed162791d6 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.690208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000366e-fdbb-4f22-9075-107df792fea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.690859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000366e-fdbb-4f22-9075-107df792fea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.691172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000366e-fdbb-4f22-9075-107df792fea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.691448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000366e-fdbb-4f22-9075-107df792fea2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.692174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000366e-fdbb-4f22-9075-107df792fea2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:19:56.692477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000366e-fdbb-4f22-9075-107df792fea2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.694077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000366e-fdbb-4f22-9075-107df792fea2 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.706550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1196/2352] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:19:56.711127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8851b-65d8-4692-a47e-a29ebd3f3163 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.721577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8851b-65d8-4692-a47e-a29ebd3f3163 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.726219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5bff3-75cd-42fb-8651-3abc4ced5eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.726893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5bff3-75cd-42fb-8651-3abc4ced5eea admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.727218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5bff3-75cd-42fb-8651-3abc4ced5eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.727498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5bff3-75cd-42fb-8651-3abc4ced5eea admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.728194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5bff3-75cd-42fb-8651-3abc4ced5eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.730123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5bff3-75cd-42fb-8651-3abc4ced5eea admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.757376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1157/2353] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:19:56 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:56.761335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000366e-fdbb-4f22-9075-107df792fea2 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.772353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000366e-fdbb-4f22-9075-107df792fea2 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.836709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8f256-a2be-4c50-ae69-5baa7b878bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.837380 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8f256-a2be-4c50-ae69-5baa7b878bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.837661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8f256-a2be-4c50-ae69-5baa7b878bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.837936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c8f256-a2be-4c50-ae69-5baa7b878bdc admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.838677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8f256-a2be-4c50-ae69-5baa7b878bdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.840996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c8f256-a2be-4c50-ae69-5baa7b878bdc admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.861243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1197/2354] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:19:56 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:19:56.865538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5bff3-75cd-42fb-8651-3abc4ced5eea admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.876615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5bff3-75cd-42fb-8651-3abc4ced5eea admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.881555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86931de-a180-4c7c-b8cc-936f8384c8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.882210 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86931de-a180-4c7c-b8cc-936f8384c8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.882491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86931de-a180-4c7c-b8cc-936f8384c8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.882766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86931de-a180-4c7c-b8cc-936f8384c8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.883543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86931de-a180-4c7c-b8cc-936f8384c8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.885522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86931de-a180-4c7c-b8cc-936f8384c8c9 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.897251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1158/2355] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:56.902758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8f256-a2be-4c50-ae69-5baa7b878bdc admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.913542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c8f256-a2be-4c50-ae69-5baa7b878bdc admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.918826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83c3607-ba63-4c2e-92fb-4e3a65f5c959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.919749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3607-ba63-4c2e-92fb-4e3a65f5c959 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.920061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3607-ba63-4c2e-92fb-4e3a65f5c959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.920327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83c3607-ba63-4c2e-92fb-4e3a65f5c959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.921053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c3607-ba63-4c2e-92fb-4e3a65f5c959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.922675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83c3607-ba63-4c2e-92fb-4e3a65f5c959 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.934701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1198/2356] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:19:56.938758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86931de-a180-4c7c-b8cc-936f8384c8c9 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:56.952780 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86931de-a180-4c7c-b8cc-936f8384c8c9 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:56.958423 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc25171-2f8a-4b3a-bd96-0ea67ecdbcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:56.959368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc25171-2f8a-4b3a-bd96-0ea67ecdbcba admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:56.959659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc25171-2f8a-4b3a-bd96-0ea67ecdbcba admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:56.959940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc25171-2f8a-4b3a-bd96-0ea67ecdbcba admin admin] PATH_INFO: `/v3/projects/0e56f4657b9d4006bac8147212c13895/users/18d4edc9977444b7940579c8e7477c9c/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:56.978469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc25171-2f8a-4b3a-bd96-0ea67ecdbcba admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e56f4657b9d4006bac8147212c13895, user_id=18d4edc9977444b7940579c8e7477c9c, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:56.982128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc25171-2f8a-4b3a-bd96-0ea67ecdbcba admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:56.998051 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1159/2357] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:19:56 2022] PUT /identity/v3/projects/0e56f4657b9d4006bac8147212c13895/users/18d4edc9977444b7940579c8e7477c9c/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:19:57.003384 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963aedd-5b5e-420f-8b61-347f339cd91f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:57.004053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963aedd-5b5e-420f-8b61-347f339cd91f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:57.004053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2963aedd-5b5e-420f-8b61-347f339cd91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:57.022727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2963aedd-5b5e-420f-8b61-347f339cd91f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:57.024458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2963aedd-5b5e-420f-8b61-347f339cd91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:57.087949 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1199/2358] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:19:57.098045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc25171-2f8a-4b3a-bd96-0ea67ecdbcba admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:57.099839 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-dfc25171-2f8a-4b3a-bd96-0ea67ecdbcba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:57.160657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc25171-2f8a-4b3a-bd96-0ea67ecdbcba admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:57.164356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa639a7c-37e1-448b-8159-f61def858b63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:57.165037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa639a7c-37e1-448b-8159-f61def858b63 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:57.165324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa639a7c-37e1-448b-8159-f61def858b63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:57.165598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa639a7c-37e1-448b-8159-f61def858b63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:57.175925 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa639a7c-37e1-448b-8159-f61def858b63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:57.177363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa639a7c-37e1-448b-8159-f61def858b63 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:57.188947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1160/2359] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:19:58.485595 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc313-ac76-45fd-a795-3246df1545cb None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:58.486071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc313-ac76-45fd-a795-3246df1545cb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:58.486164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabc313-ac76-45fd-a795-3246df1545cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:58.517200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-5fabc313-ac76-45fd-a795-3246df1545cb None None] MFA Rules not processed for user `18d4edc9977444b7940579c8e7477c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:19:58.518430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-5fabc313-ac76-45fd-a795-3246df1545cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:58.559084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:58.604308 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1200/2360] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:19:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:19:58.616944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa639a7c-37e1-448b-8159-f61def858b63 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:19:58.618610 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fa639a7c-37e1-448b-8159-f61def858b63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:19:58.646410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:19:58.707351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa639a7c-37e1-448b-8159-f61def858b63 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:19:58.711248 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89145c6c-059e-439b-9c9e-084cfb7283a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:19:58.712028 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89145c6c-059e-439b-9c9e-084cfb7283a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:19:58.712392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89145c6c-059e-439b-9c9e-084cfb7283a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:19:58.712866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89145c6c-059e-439b-9c9e-084cfb7283a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:19:58.722977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89145c6c-059e-439b-9c9e-084cfb7283a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:19:58.724709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89145c6c-059e-439b-9c9e-084cfb7283a6 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:19:58.738073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1161/2361] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:19:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:00.108277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d19f73-c3b9-4156-97ef-b5ce59f68782 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:00.108777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d19f73-c3b9-4156-97ef-b5ce59f68782 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:00.108869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d19f73-c3b9-4156-97ef-b5ce59f68782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:00.126236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b5d19f73-c3b9-4156-97ef-b5ce59f68782 None None] MFA Rules not processed for user `18d4edc9977444b7940579c8e7477c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:00.127456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b5d19f73-c3b9-4156-97ef-b5ce59f68782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:00.134116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1201/2362] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:08.732965 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=19 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:09.295376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46ef7-bab3-4c7f-bf38-e47b5d37985f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:09.296037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46ef7-bab3-4c7f-bf38-e47b5d37985f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:09.296498 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e46ef7-bab3-4c7f-bf38-e47b5d37985f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:09.322012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-a3e46ef7-bab3-4c7f-bf38-e47b5d37985f None None] MFA Rules not processed for user `9b6716c39cc74e3c8b3949773023c2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:09.323398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a3e46ef7-bab3-4c7f-bf38-e47b5d37985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:09.380959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1162/2363] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:10.121029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=16 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:16.469101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f429ed-86fe-4016-98c7-e5161149fb38 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:16.469684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f429ed-86fe-4016-98c7-e5161149fb38 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:16.469684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f429ed-86fe-4016-98c7-e5161149fb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:16.497920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-53f429ed-86fe-4016-98c7-e5161149fb38 None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:16.499195 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-53f429ed-86fe-4016-98c7-e5161149fb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:16.573286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1202/2364] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:20:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:16.643682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46ef7-bab3-4c7f-bf38-e47b5d37985f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:16.645347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a3e46ef7-bab3-4c7f-bf38-e47b5d37985f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:16.775385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e46ef7-bab3-4c7f-bf38-e47b5d37985f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:16.782459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c71a6-6d24-4b65-aa4e-df551c7c2bbe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:16.783399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c71a6-6d24-4b65-aa4e-df551c7c2bbe service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:16.783730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c71a6-6d24-4b65-aa4e-df551c7c2bbe service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:16.784155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c71a6-6d24-4b65-aa4e-df551c7c2bbe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:16.813148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c71a6-6d24-4b65-aa4e-df551c7c2bbe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:16.815305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0c71a6-6d24-4b65-aa4e-df551c7c2bbe service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:16.868725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1163/2365] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:20:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:20:17.505061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c084f-b239-4ca1-9d90-7505b3d2f58a None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.505516 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c084f-b239-4ca1-9d90-7505b3d2f58a None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.505931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9c084f-b239-4ca1-9d90-7505b3d2f58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.524818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-3b9c084f-b239-4ca1-9d90-7505b3d2f58a None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:17.526011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3b9c084f-b239-4ca1-9d90-7505b3d2f58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:17.533871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1203/2366] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 21 04:20:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:17.547434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c71a6-6d24-4b65-aa4e-df551c7c2bbe service swift] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:17.557983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0c71a6-6d24-4b65-aa4e-df551c7c2bbe service swift] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:17.563777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b811dcc-d2e2-4cfb-a725-57318d17551f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:17.564419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811dcc-d2e2-4cfb-a725-57318d17551f service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.564728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811dcc-d2e2-4cfb-a725-57318d17551f service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.564984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b811dcc-d2e2-4cfb-a725-57318d17551f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.573118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b811dcc-d2e2-4cfb-a725-57318d17551f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:17.575200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b811dcc-d2e2-4cfb-a725-57318d17551f service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:17.583254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1164/2367] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:20:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:20:17.778532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c71f05-a7ec-4a21-9384-49087a9c700c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.779034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c71f05-a7ec-4a21-9384-49087a9c700c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.779406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c71f05-a7ec-4a21-9384-49087a9c700c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.797518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-f3c71f05-a7ec-4a21-9384-49087a9c700c None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:17.798874 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f3c71f05-a7ec-4a21-9384-49087a9c700c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:17.806302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1204/2368] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:20:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:17.820942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b811dcc-d2e2-4cfb-a725-57318d17551f service swift] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:17.831891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b811dcc-d2e2-4cfb-a725-57318d17551f service swift] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:17.836970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e7b6e-1b5b-414a-882f-9459dfc10653 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:17.837614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7b6e-1b5b-414a-882f-9459dfc10653 service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:17.838100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7b6e-1b5b-414a-882f-9459dfc10653 service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:17.838440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e7b6e-1b5b-414a-882f-9459dfc10653 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:17.847409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e7b6e-1b5b-414a-882f-9459dfc10653 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:17.849281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e7b6e-1b5b-414a-882f-9459dfc10653 service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:17.858572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1165/2369] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:20:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:20:18.201886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba68b1-dc9e-421a-855b-ada2916b4e10 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.202180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba68b1-dc9e-421a-855b-ada2916b4e10 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.202465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba68b1-dc9e-421a-855b-ada2916b4e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.220846 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a9ba68b1-dc9e-421a-855b-ada2916b4e10 None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:18.222038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a9ba68b1-dc9e-421a-855b-ada2916b4e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:18.229087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1205/2370] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 21 04:20:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:18.241576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e7b6e-1b5b-414a-882f-9459dfc10653 service swift] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:18.252056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e7b6e-1b5b-414a-882f-9459dfc10653 service swift] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:18.256980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05c39c-5b04-4856-ad5a-1f835849dbeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:18.257606 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05c39c-5b04-4856-ad5a-1f835849dbeb service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:18.257887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05c39c-5b04-4856-ad5a-1f835849dbeb service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:18.258159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05c39c-5b04-4856-ad5a-1f835849dbeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:18.266081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05c39c-5b04-4856-ad5a-1f835849dbeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:18.267723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05c39c-5b04-4856-ad5a-1f835849dbeb service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:18.275574 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1166/2371] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:20:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:20:20.349328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba68b1-dc9e-421a-855b-ada2916b4e10 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:20.350734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a9ba68b1-dc9e-421a-855b-ada2916b4e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:20.364974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba68b1-dc9e-421a-855b-ada2916b4e10 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:20.369397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:20.370269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:20.370530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:20.370804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] PATH_INFO: `/v3/users/5444c7cab8b24c77b193db0d320bfbf0` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:20.372011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5444c7cab8b24c77b193db0d320bfbf0)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:20.374109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:20.422122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5444c7cab8b24c77b193db0d320bfbf0'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.422795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5444c7cab8b24c77b193db0d320bfbf0'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.423444 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5444c7cab8b24c77b193db0d320bfbf0'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.430391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5444c7cab8b24c77b193db0d320bfbf0'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.438255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5444c7cab8b24c77b193db0d320bfbf0'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.456837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1206/2372] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:20 2022] DELETE /identity/v3/users/5444c7cab8b24c77b193db0d320bfbf0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:20.461598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6a221-a122-48d0-8d97-bb6301f8e668 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:20.462074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6a221-a122-48d0-8d97-bb6301f8e668 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:20.462183 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6a221-a122-48d0-8d97-bb6301f8e668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:20.479692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-47e6a221-a122-48d0-8d97-bb6301f8e668 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:20.480897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-47e6a221-a122-48d0-8d97-bb6301f8e668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:20.528297 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:20.540332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1167/2373] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:20.554395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:20.555981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:20.614021 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1198c4b6-928b-4f80-948c-808e8558d1bd admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:20.617592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37124a7-1387-499e-93af-105016e378dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:20.618233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37124a7-1387-499e-93af-105016e378dd service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:20.618518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37124a7-1387-499e-93af-105016e378dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:20.618797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37124a7-1387-499e-93af-105016e378dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:20.628128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37124a7-1387-499e-93af-105016e378dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:20.629588 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37124a7-1387-499e-93af-105016e378dd service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:20.634588 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:20.640075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1207/2374] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:20.808491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6a221-a122-48d0-8d97-bb6301f8e668 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:20.809928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-47e6a221-a122-48d0-8d97-bb6301f8e668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:20.823053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6a221-a122-48d0-8d97-bb6301f8e668 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:20.828720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:20.829615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:20.829899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:20.830172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] PATH_INFO: `/v3/projects/d89787eb886944db9d241fbf90ebfed0` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:20.831387 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d89787eb886944db9d241fbf90ebfed0)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:20.833345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:20.880069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd89787eb886944db9d241fbf90ebfed0', 'request_id': 'req-240211c0-342c-4cb8-b477-e0a2388044fe'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.886916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd89787eb886944db9d241fbf90ebfed0', 'request_id': 'req-240211c0-342c-4cb8-b477-e0a2388044fe'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.892934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd89787eb886944db9d241fbf90ebfed0', 'request_id': 'req-240211c0-342c-4cb8-b477-e0a2388044fe'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.903845 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] The token cache is being invalidate because project d89787eb886944db9d241fbf90ebfed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:20.904688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.905347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-240211c0-342c-4cb8-b477-e0a2388044fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:20.906899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1168/2375] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:20 2022] DELETE /identity/v3/projects/d89787eb886944db9d241fbf90ebfed0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:20.912375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3925bfb-0bde-4a6d-9e94-4b96e0172aef None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:20.912670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3925bfb-0bde-4a6d-9e94-4b96e0172aef None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:20.912959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3925bfb-0bde-4a6d-9e94-4b96e0172aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:20.930679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e3925bfb-0bde-4a6d-9e94-4b96e0172aef None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:20.931909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e3925bfb-0bde-4a6d-9e94-4b96e0172aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:20.990438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1208/2376] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:20.998573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2c64-f606-4875-9db9-380efedd8296 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:20.998940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2c64-f606-4875-9db9-380efedd8296 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:20.999244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743d2c64-f606-4875-9db9-380efedd8296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.018886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-743d2c64-f606-4875-9db9-380efedd8296 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:21.020164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-743d2c64-f606-4875-9db9-380efedd8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:21.028932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1169/2377] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:21.033028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3925bfb-0bde-4a6d-9e94-4b96e0172aef None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.045114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3925bfb-0bde-4a6d-9e94-4b96e0172aef None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.050219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ca46c-ee12-4eb1-872c-355c76e9ccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.050880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ca46c-ee12-4eb1-872c-355c76e9ccc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.051216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ca46c-ee12-4eb1-872c-355c76e9ccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.051526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ca46c-ee12-4eb1-872c-355c76e9ccc3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.052259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ca46c-ee12-4eb1-872c-355c76e9ccc3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:20:21.052572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ca46c-ee12-4eb1-872c-355c76e9ccc3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.054330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ca46c-ee12-4eb1-872c-355c76e9ccc3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.067852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1209/2378] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:20:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:20:21.072342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d2c64-f606-4875-9db9-380efedd8296 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.082389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743d2c64-f606-4875-9db9-380efedd8296 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.088179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf4a63-19e7-4b0a-aafa-50ca32915234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.088874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf4a63-19e7-4b0a-aafa-50ca32915234 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.089295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf4a63-19e7-4b0a-aafa-50ca32915234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.089580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf4a63-19e7-4b0a-aafa-50ca32915234 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.090294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf4a63-19e7-4b0a-aafa-50ca32915234 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.093240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf4a63-19e7-4b0a-aafa-50ca32915234 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.120871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1170/2379] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:21 2022] POST /identity/v3/projects => generated 391 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:21.125340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ca46c-ee12-4eb1-872c-355c76e9ccc3 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.135583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ca46c-ee12-4eb1-872c-355c76e9ccc3 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.194879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f57ac-2215-4012-87f7-f64cc657d02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.195654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f57ac-2215-4012-87f7-f64cc657d02e admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.196009 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f57ac-2215-4012-87f7-f64cc657d02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.196356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f57ac-2215-4012-87f7-f64cc657d02e admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.197126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f57ac-2215-4012-87f7-f64cc657d02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.199168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f57ac-2215-4012-87f7-f64cc657d02e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.226982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1210/2380] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:21 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:20:21.227206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf4a63-19e7-4b0a-aafa-50ca32915234 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.236055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf4a63-19e7-4b0a-aafa-50ca32915234 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.241456 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f05e6-43de-4439-a559-c8ee761333bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.242165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f05e6-43de-4439-a559-c8ee761333bd admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.242414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f05e6-43de-4439-a559-c8ee761333bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.242684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f05e6-43de-4439-a559-c8ee761333bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.243440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f05e6-43de-4439-a559-c8ee761333bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.245066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f05e6-43de-4439-a559-c8ee761333bd admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.257840 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1171/2381] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:20:21.269575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f57ac-2215-4012-87f7-f64cc657d02e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.281933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f57ac-2215-4012-87f7-f64cc657d02e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.286646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c65dc3-78c2-4c2e-beb2-3c66673bfb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.287334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c65dc3-78c2-4c2e-beb2-3c66673bfb5f admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.287616 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c65dc3-78c2-4c2e-beb2-3c66673bfb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.287886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c65dc3-78c2-4c2e-beb2-3c66673bfb5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.288617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c65dc3-78c2-4c2e-beb2-3c66673bfb5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.290228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c65dc3-78c2-4c2e-beb2-3c66673bfb5f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.302291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1211/2382] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:21.306588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f05e6-43de-4439-a559-c8ee761333bd admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.321073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f05e6-43de-4439-a559-c8ee761333bd admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.326559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8274dfd-ffa3-4d27-91c4-8fd94bb8fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.327504 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8274dfd-ffa3-4d27-91c4-8fd94bb8fb82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.327783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8274dfd-ffa3-4d27-91c4-8fd94bb8fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.328058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8274dfd-ffa3-4d27-91c4-8fd94bb8fb82 admin admin] PATH_INFO: `/v3/projects/7b5f51fc841e449198d7a0dee3bdf560/users/2d4b0ff2e1ba412f962cb5756e6ac2aa/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.343996 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8274dfd-ffa3-4d27-91c4-8fd94bb8fb82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b5f51fc841e449198d7a0dee3bdf560, user_id=2d4b0ff2e1ba412f962cb5756e6ac2aa, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.346900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8274dfd-ffa3-4d27-91c4-8fd94bb8fb82 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.361373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1172/2383] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:21 2022] PUT /identity/v3/projects/7b5f51fc841e449198d7a0dee3bdf560/users/2d4b0ff2e1ba412f962cb5756e6ac2aa/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:20:21.371569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae6ad8-73b5-4889-982d-15f270912ea6 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.372067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae6ad8-73b5-4889-982d-15f270912ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.372171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ae6ad8-73b5-4889-982d-15f270912ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.401675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-21ae6ad8-73b5-4889-982d-15f270912ea6 None None] MFA Rules not processed for user `2d4b0ff2e1ba412f962cb5756e6ac2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:21.402828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-21ae6ad8-73b5-4889-982d-15f270912ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:21.461188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:21.471699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1212/2384] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:20:21.482923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8274dfd-ffa3-4d27-91c4-8fd94bb8fb82 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:21.484882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e8274dfd-ffa3-4d27-91c4-8fd94bb8fb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:21.540384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8274dfd-ffa3-4d27-91c4-8fd94bb8fb82 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:21.543992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d17701-b002-4e3e-970c-e1bd2fe7a3fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:21.544656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17701-b002-4e3e-970c-e1bd2fe7a3fe service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:21.544966 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17701-b002-4e3e-970c-e1bd2fe7a3fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:21.545243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d17701-b002-4e3e-970c-e1bd2fe7a3fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:21.553558 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d17701-b002-4e3e-970c-e1bd2fe7a3fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:21.555012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d17701-b002-4e3e-970c-e1bd2fe7a3fe service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:21.564232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1173/2385] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:31.469492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:31.560024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=82,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:31.646397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae6ad8-73b5-4889-982d-15f270912ea6 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:31.711896 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ae6ad8-73b5-4889-982d-15f270912ea6 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:31.718718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:31.719731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:31.719947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:31.720222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] PATH_INFO: `/v3/users/2d4b0ff2e1ba412f962cb5756e6ac2aa` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:31.721568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d4b0ff2e1ba412f962cb5756e6ac2aa)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:31.724052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:31.780627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d4b0ff2e1ba412f962cb5756e6ac2aa'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:31.781304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d4b0ff2e1ba412f962cb5756e6ac2aa'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:31.781904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d4b0ff2e1ba412f962cb5756e6ac2aa'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:31.789560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d4b0ff2e1ba412f962cb5756e6ac2aa'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:31.797343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d4b0ff2e1ba412f962cb5756e6ac2aa'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:31.814876 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1213/2386] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:20:31 2022] DELETE /identity/v3/users/2d4b0ff2e1ba412f962cb5756e6ac2aa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:31.819404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa92b5-cd5b-403f-93d7-0d5996c75537 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:31.819690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa92b5-cd5b-403f-93d7-0d5996c75537 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:31.819968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa92b5-cd5b-403f-93d7-0d5996c75537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:31.839229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-bbaa92b5-cd5b-403f-93d7-0d5996c75537 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:31.840737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bbaa92b5-cd5b-403f-93d7-0d5996c75537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:31.902185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1174/2387] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:31.912778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:31.914189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:31.976112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091974e-cddd-497b-beb2-e3063af871b7 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:31.979684 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf52350-133c-4042-97e3-fcebe6d08c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:31.980326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf52350-133c-4042-97e3-fcebe6d08c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:31.980613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf52350-133c-4042-97e3-fcebe6d08c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:31.980918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf52350-133c-4042-97e3-fcebe6d08c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:31.990147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf52350-133c-4042-97e3-fcebe6d08c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:31.991628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf52350-133c-4042-97e3-fcebe6d08c6e service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:32.001402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1214/2388] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:32.284519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa92b5-cd5b-403f-93d7-0d5996c75537 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:32.286114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bbaa92b5-cd5b-403f-93d7-0d5996c75537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:32.300054 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa92b5-cd5b-403f-93d7-0d5996c75537 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:32.305313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:32.306389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:32.306921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:32.307583 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] PATH_INFO: `/v3/projects/7b5f51fc841e449198d7a0dee3bdf560` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:32.309142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b5f51fc841e449198d7a0dee3bdf560)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:32.311680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:32.359426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b5f51fc841e449198d7a0dee3bdf560', 'request_id': 'req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:32.368537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b5f51fc841e449198d7a0dee3bdf560', 'request_id': 'req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:32.375354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b5f51fc841e449198d7a0dee3bdf560', 'request_id': 'req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:32.386695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] The token cache is being invalidate because project 7b5f51fc841e449198d7a0dee3bdf560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:20:32.387016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:32.387692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-ff47ef5c-76cf-4baf-a15f-52cc2e77cdbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:20:32.390114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1175/2389] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:20:32 2022] DELETE /identity/v3/projects/7b5f51fc841e449198d7a0dee3bdf560 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:32.395006 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a31c5d-0464-4e36-ac86-985d9177decb None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:32.395304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a31c5d-0464-4e36-ac86-985d9177decb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:32.395588 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a31c5d-0464-4e36-ac86-985d9177decb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:32.412978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-42a31c5d-0464-4e36-ac86-985d9177decb None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:32.414216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-42a31c5d-0464-4e36-ac86-985d9177decb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:32.433802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:32.479686 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1215/2390] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:32.542476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28df2-f3b4-4ead-90e7-3cf461fbfff8 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:32.542824 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28df2-f3b4-4ead-90e7-3cf461fbfff8 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:32.543085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a28df2-f3b4-4ead-90e7-3cf461fbfff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:32.562473 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-38a28df2-f3b4-4ead-90e7-3cf461fbfff8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:32.563486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-38a28df2-f3b4-4ead-90e7-3cf461fbfff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:32.571430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1176/2391] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:32.575585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a31c5d-0464-4e36-ac86-985d9177decb None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:32.585897 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a31c5d-0464-4e36-ac86-985d9177decb None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:32.590392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3dbf3c-0197-466c-89ee-c4b0c0c1373a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:32.591076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dbf3c-0197-466c-89ee-c4b0c0c1373a admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:32.591363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dbf3c-0197-466c-89ee-c4b0c0c1373a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:32.592148 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3dbf3c-0197-466c-89ee-c4b0c0c1373a admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:32.592870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3dbf3c-0197-466c-89ee-c4b0c0c1373a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:20:32.593178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3dbf3c-0197-466c-89ee-c4b0c0c1373a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:32.595097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3dbf3c-0197-466c-89ee-c4b0c0c1373a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:32.608369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1216/2392] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:20:32.612672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a28df2-f3b4-4ead-90e7-3cf461fbfff8 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:32.621888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a28df2-f3b4-4ead-90e7-3cf461fbfff8 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:32.627224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a16f3-fa7c-416f-865e-b0fe62f627ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:32.627868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a16f3-fa7c-416f-865e-b0fe62f627ea admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:32.628146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a16f3-fa7c-416f-865e-b0fe62f627ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:32.628419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a16f3-fa7c-416f-865e-b0fe62f627ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:32.629101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a16f3-fa7c-416f-865e-b0fe62f627ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:32.631058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a16f3-fa7c-416f-865e-b0fe62f627ea admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:32.658770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1177/2393] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:32 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:32.663219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3dbf3c-0197-466c-89ee-c4b0c0c1373a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:32.674143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3dbf3c-0197-466c-89ee-c4b0c0c1373a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:32.737045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83210e78-fd15-42af-a0a1-84ba1ebb81fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:32.737647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210e78-fd15-42af-a0a1-84ba1ebb81fb admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:32.737929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210e78-fd15-42af-a0a1-84ba1ebb81fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:32.738202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83210e78-fd15-42af-a0a1-84ba1ebb81fb admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:32.738881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83210e78-fd15-42af-a0a1-84ba1ebb81fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:32.740833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83210e78-fd15-42af-a0a1-84ba1ebb81fb admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:32.761252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1217/2394] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:32 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:20:32.765413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a16f3-fa7c-416f-865e-b0fe62f627ea admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:32.775519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a16f3-fa7c-416f-865e-b0fe62f627ea admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:32.780227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b67e3-5135-4a47-86e1-b7d5f4b34a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:32.780874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b67e3-5135-4a47-86e1-b7d5f4b34a31 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:32.781156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b67e3-5135-4a47-86e1-b7d5f4b34a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:32.781432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b67e3-5135-4a47-86e1-b7d5f4b34a31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:32.782147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b67e3-5135-4a47-86e1-b7d5f4b34a31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:32.783826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b67e3-5135-4a47-86e1-b7d5f4b34a31 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:32.795445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1178/2395] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:32.799315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83210e78-fd15-42af-a0a1-84ba1ebb81fb admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:32.809636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83210e78-fd15-42af-a0a1-84ba1ebb81fb admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:32.815061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d8a8e3-0db2-4689-8ad3-29ff43629d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:32.815731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a8e3-0db2-4689-8ad3-29ff43629d11 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:32.816015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a8e3-0db2-4689-8ad3-29ff43629d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:32.816293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d8a8e3-0db2-4689-8ad3-29ff43629d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:32.817019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8a8e3-0db2-4689-8ad3-29ff43629d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:32.818630 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d8a8e3-0db2-4689-8ad3-29ff43629d11 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:32.828712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1218/2396] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:20:32.832742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b67e3-5135-4a47-86e1-b7d5f4b34a31 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:32.842763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b67e3-5135-4a47-86e1-b7d5f4b34a31 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:32.847531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e6b7f-e1d3-445f-a8c5-8486dc73dd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:32.848434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e6b7f-e1d3-445f-a8c5-8486dc73dd78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:32.848740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e6b7f-e1d3-445f-a8c5-8486dc73dd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:32.849018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e6b7f-e1d3-445f-a8c5-8486dc73dd78 admin admin] PATH_INFO: `/v3/projects/0f7615e1d2824c6487d89f0a64bc6fbc/users/84dce5bebadc4b1bb3403132a0767ed8/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:32.864788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e6b7f-e1d3-445f-a8c5-8486dc73dd78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7615e1d2824c6487d89f0a64bc6fbc, user_id=84dce5bebadc4b1bb3403132a0767ed8, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:32.867494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e6b7f-e1d3-445f-a8c5-8486dc73dd78 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:32.881550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1179/2397] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:32 2022] PUT /identity/v3/projects/0f7615e1d2824c6487d89f0a64bc6fbc/users/84dce5bebadc4b1bb3403132a0767ed8/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:32.886593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab62085-59b5-487b-860a-c34326f312e8 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:32.886885 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab62085-59b5-487b-860a-c34326f312e8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:32.887205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab62085-59b5-487b-860a-c34326f312e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:32.906032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-cab62085-59b5-487b-860a-c34326f312e8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:32.907291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-cab62085-59b5-487b-860a-c34326f312e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:32.970050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1219/2398] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:32.979677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e6b7f-e1d3-445f-a8c5-8486dc73dd78 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:32.981356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e22e6b7f-e1d3-445f-a8c5-8486dc73dd78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:33.004808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:33.041841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e6b7f-e1d3-445f-a8c5-8486dc73dd78 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:33.046777 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e7694-2451-45dd-8fee-b930342bccf7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:33.047474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e7694-2451-45dd-8fee-b930342bccf7 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:33.047761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e7694-2451-45dd-8fee-b930342bccf7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:33.048041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e7694-2451-45dd-8fee-b930342bccf7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:33.057712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e7694-2451-45dd-8fee-b930342bccf7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:33.059201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e7694-2451-45dd-8fee-b930342bccf7 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:33.069448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1180/2399] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:20:36.970798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557bd9e-345c-49de-bdc8-9731ed06f7cc None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:36.971583 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557bd9e-345c-49de-bdc8-9731ed06f7cc None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:36.973309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f557bd9e-345c-49de-bdc8-9731ed06f7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:37.005821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-f557bd9e-345c-49de-bdc8-9731ed06f7cc None None] MFA Rules not processed for user `84dce5bebadc4b1bb3403132a0767ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:37.007063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f557bd9e-345c-49de-bdc8-9731ed06f7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:37.026501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:37.091601 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1220/2400] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:37.092790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e7694-2451-45dd-8fee-b930342bccf7 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:37.103349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e7694-2451-45dd-8fee-b930342bccf7 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:37.109157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff484980-de50-4ff5-b97c-365c9ecd3993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:37.109827 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff484980-de50-4ff5-b97c-365c9ecd3993 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:37.110113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff484980-de50-4ff5-b97c-365c9ecd3993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:37.110392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff484980-de50-4ff5-b97c-365c9ecd3993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:37.111139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff484980-de50-4ff5-b97c-365c9ecd3993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:37.113080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff484980-de50-4ff5-b97c-365c9ecd3993 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:37.144093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1181/2401] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:20:37 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:20:37.148178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557bd9e-345c-49de-bdc8-9731ed06f7cc None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:37.161606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f557bd9e-345c-49de-bdc8-9731ed06f7cc None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:37.247227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfee027-c805-4b3a-9e5b-f5caeeff1ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:37.249077 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee027-c805-4b3a-9e5b-f5caeeff1ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:37.249369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee027-c805-4b3a-9e5b-f5caeeff1ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:37.250000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfee027-c805-4b3a-9e5b-f5caeeff1ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:37.251375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfee027-c805-4b3a-9e5b-f5caeeff1ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:37.254307 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfee027-c805-4b3a-9e5b-f5caeeff1ad7 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:37.286009 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1221/2402] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:20:37 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:20:37.289640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff484980-de50-4ff5-b97c-365c9ecd3993 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:37.302307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff484980-de50-4ff5-b97c-365c9ecd3993 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:37.311535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe10c17-e1d5-43e6-aefd-904e3cc72936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:37.312233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe10c17-e1d5-43e6-aefd-904e3cc72936 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:37.312519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe10c17-e1d5-43e6-aefd-904e3cc72936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:37.312802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe10c17-e1d5-43e6-aefd-904e3cc72936 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:37.314142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe10c17-e1d5-43e6-aefd-904e3cc72936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:37.316014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe10c17-e1d5-43e6-aefd-904e3cc72936 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:37.336862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1182/2403] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:20:37.341449 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfee027-c805-4b3a-9e5b-f5caeeff1ad7 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:37.358321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfee027-c805-4b3a-9e5b-f5caeeff1ad7 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:37.371099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf518c-306b-41ee-8cc6-baeabaf161de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:37.373080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf518c-306b-41ee-8cc6-baeabaf161de admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:37.374139 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf518c-306b-41ee-8cc6-baeabaf161de admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:37.374533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf518c-306b-41ee-8cc6-baeabaf161de admin admin] PATH_INFO: `/v3/projects/a556dba66e3442d0a7c95aeabaa249bc/users/b21b9d87e6864762b90a610270182263/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:37.398450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf518c-306b-41ee-8cc6-baeabaf161de admin admin] RBAC: Authorizing `identity:create_grant(project_id=a556dba66e3442d0a7c95aeabaa249bc, user_id=b21b9d87e6864762b90a610270182263, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:37.401179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf518c-306b-41ee-8cc6-baeabaf161de admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:37.417336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1222/2404] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:37 2022] PUT /identity/v3/projects/a556dba66e3442d0a7c95aeabaa249bc/users/b21b9d87e6864762b90a610270182263/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:37.421666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe10c17-e1d5-43e6-aefd-904e3cc72936 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:37.434129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe10c17-e1d5-43e6-aefd-904e3cc72936 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:37.500279 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b45d4-314c-4aa5-8ecf-d604f3774ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:37.500963 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b45d4-314c-4aa5-8ecf-d604f3774ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:37.501255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b45d4-314c-4aa5-8ecf-d604f3774ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:37.501529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b45d4-314c-4aa5-8ecf-d604f3774ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:37.502322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b45d4-314c-4aa5-8ecf-d604f3774ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:37.504038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b45d4-314c-4aa5-8ecf-d604f3774ffe admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:37.516185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1183/2405] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:20:37.520395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf518c-306b-41ee-8cc6-baeabaf161de admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:37.531681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf518c-306b-41ee-8cc6-baeabaf161de admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:37.536560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e54968-7269-4147-ae83-cbabf936b0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:37.537478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54968-7269-4147-ae83-cbabf936b0aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:37.537759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54968-7269-4147-ae83-cbabf936b0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:37.538037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e54968-7269-4147-ae83-cbabf936b0aa admin admin] PATH_INFO: `/v3/projects/a556dba66e3442d0a7c95aeabaa249bc/users/b21b9d87e6864762b90a610270182263/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:37.540068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e54968-7269-4147-ae83-cbabf936b0aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a556dba66e3442d0a7c95aeabaa249bc, user_id=b21b9d87e6864762b90a610270182263, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:37.542745 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e54968-7269-4147-ae83-cbabf936b0aa admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:37.557679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1223/2406] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:20:37 2022] PUT /identity/v3/projects/a556dba66e3442d0a7c95aeabaa249bc/users/b21b9d87e6864762b90a610270182263/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:20:42.517739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fa562-6bd2-42fe-b38a-04204635feaf None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:42.518868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fa562-6bd2-42fe-b38a-04204635feaf None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:42.519181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432fa562-6bd2-42fe-b38a-04204635feaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:42.551705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-432fa562-6bd2-42fe-b38a-04204635feaf None None] MFA Rules not processed for user `b21b9d87e6864762b90a610270182263`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:42.553182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-432fa562-6bd2-42fe-b38a-04204635feaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:42.639197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1184/2407] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:42.647651 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e54968-7269-4147-ae83-cbabf936b0aa admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:42.650216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-13e54968-7269-4147-ae83-cbabf936b0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:42.736464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e54968-7269-4147-ae83-cbabf936b0aa admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:42.745954 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b333fb-e3ac-43dc-b3ab-574ee65c6e3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210e10ee6b649399de11ac719a89718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:42.746333 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b333fb-e3ac-43dc-b3ab-574ee65c6e3e service glance] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:42.753270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b333fb-e3ac-43dc-b3ab-574ee65c6e3e service glance] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:42.758703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b333fb-e3ac-43dc-b3ab-574ee65c6e3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:42.801758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:42.842828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b333fb-e3ac-43dc-b3ab-574ee65c6e3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:42.845085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b333fb-e3ac-43dc-b3ab-574ee65c6e3e service glance] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:42.857418 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1224/2408] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:42.978790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb7e1e-11ba-4cfb-b170-c00ac1c20a30 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:42.979391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb7e1e-11ba-4cfb-b170-c00ac1c20a30 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:42.979731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb7e1e-11ba-4cfb-b170-c00ac1c20a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:43.001805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c6eb7e1e-11ba-4cfb-b170-c00ac1c20a30 None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:43.003195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c6eb7e1e-11ba-4cfb-b170-c00ac1c20a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:43.009170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:20:43.087362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1185/2409] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:20:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:43.098180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b333fb-e3ac-43dc-b3ab-574ee65c6e3e service glance] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:43.103426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-08b333fb-e3ac-43dc-b3ab-574ee65c6e3e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:43.118904 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db7b4-6b44-4c67-9b57-5e933290fba6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:43.119546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db7b4-6b44-4c67-9b57-5e933290fba6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:43.119546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706db7b4-6b44-4c67-9b57-5e933290fba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:43.146024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-706db7b4-6b44-4c67-9b57-5e933290fba6 None None] MFA Rules not processed for user `94d0ed0857064f368e9f09b434bf93fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:43.146929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-706db7b4-6b44-4c67-9b57-5e933290fba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:43.202600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b333fb-e3ac-43dc-b3ab-574ee65c6e3e service glance] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:43.207760 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff7c35-90de-407d-9b2a-662e60ceceab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:43.208426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff7c35-90de-407d-9b2a-662e60ceceab service swift] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:43.208718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff7c35-90de-407d-9b2a-662e60ceceab service swift] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:43.209355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ff7c35-90de-407d-9b2a-662e60ceceab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:43.217859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1186/2410] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:20:43.218270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff7c35-90de-407d-9b2a-662e60ceceab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:43.220015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ff7c35-90de-407d-9b2a-662e60ceceab service swift] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:43.228956 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1225/2411] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:20:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 04:20:49.155704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaafe4-c7be-42a9-b563-2713ad1b5c18 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:49.155704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaafe4-c7be-42a9-b563-2713ad1b5c18 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:49.156890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaaafe4-c7be-42a9-b563-2713ad1b5c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:49.200983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-6aaaafe4-c7be-42a9-b563-2713ad1b5c18 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:49.207000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6aaaafe4-c7be-42a9-b563-2713ad1b5c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:49.314178 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1187/2412] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:20:49.345671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff7c35-90de-407d-9b2a-662e60ceceab service swift] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:49.347889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a4ff7c35-90de-407d-9b2a-662e60ceceab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:49.471529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ff7c35-90de-407d-9b2a-662e60ceceab service swift] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:49.478709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468281fb-ba0e-4095-b33b-7f79db22efb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:49.479517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468281fb-ba0e-4095-b33b-7f79db22efb9 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:49.479812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468281fb-ba0e-4095-b33b-7f79db22efb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:49.480234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468281fb-ba0e-4095-b33b-7f79db22efb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:49.492632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468281fb-ba0e-4095-b33b-7f79db22efb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:49.495563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468281fb-ba0e-4095-b33b-7f79db22efb9 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:49.511272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1226/2413] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:20:54.096212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb40ae-4be5-4eff-853e-faea070464c9 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:54.096753 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb40ae-4be5-4eff-853e-faea070464c9 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:54.096864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb40ae-4be5-4eff-853e-faea070464c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:54.115187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-3cdb40ae-4be5-4eff-853e-faea070464c9 None None] MFA Rules not processed for user `84dce5bebadc4b1bb3403132a0767ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:54.116378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3cdb40ae-4be5-4eff-853e-faea070464c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:54.123544 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1188/2414] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:20:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:56.124002 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96c9fc-23f7-4c39-a6e5-3670d19dd4a7 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:56.124560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96c9fc-23f7-4c39-a6e5-3670d19dd4a7 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:56.124560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96c9fc-23f7-4c39-a6e5-3670d19dd4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:56.143530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-0e96c9fc-23f7-4c39-a6e5-3670d19dd4a7 None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:56.144654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0e96c9fc-23f7-4c39-a6e5-3670d19dd4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:56.153293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1227/2415] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:20:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:56.165312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb40ae-4be5-4eff-853e-faea070464c9 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:56.177538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb40ae-4be5-4eff-853e-faea070464c9 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:56.184194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbfa39-6a82-4b96-a461-d792b01cb6b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:56.184858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbfa39-6a82-4b96-a461-d792b01cb6b2 service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:56.185148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbfa39-6a82-4b96-a461-d792b01cb6b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:56.185425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dbfa39-6a82-4b96-a461-d792b01cb6b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:56.194243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbfa39-6a82-4b96-a461-d792b01cb6b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:56.195876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dbfa39-6a82-4b96-a461-d792b01cb6b2 service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:56.205187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1189/2416] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:20:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 04:20:57.397323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe89b-a943-4364-b31b-5a1dddc4dd9d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:57.397893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe89b-a943-4364-b31b-5a1dddc4dd9d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:57.397893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fe89b-a943-4364-b31b-5a1dddc4dd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:57.417063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-556fe89b-a943-4364-b31b-5a1dddc4dd9d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:20:57.419161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-556fe89b-a943-4364-b31b-5a1dddc4dd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:57.427141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1228/2417] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:20:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:20:57.449312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbfa39-6a82-4b96-a461-d792b01cb6b2 service swift] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:20:57.450680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-56dbfa39-6a82-4b96-a461-d792b01cb6b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:20:57.466625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dbfa39-6a82-4b96-a461-d792b01cb6b2 service swift] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:20:57.472232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f613da5-b5d4-42f4-9713-f80d1a8b406d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:20:57.472882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613da5-b5d4-42f4-9713-f80d1a8b406d service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:20:57.473167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613da5-b5d4-42f4-9713-f80d1a8b406d service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:20:57.473443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613da5-b5d4-42f4-9713-f80d1a8b406d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:20:57.483246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f613da5-b5d4-42f4-9713-f80d1a8b406d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:20:57.484841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f613da5-b5d4-42f4-9713-f80d1a8b406d service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:20:57.495178 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1190/2418] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:20:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:21:07.411896 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=88 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:07.490489 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=87 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:16.100046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11426-5ee6-44f9-a6f0-97dae90162c9 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:16.100622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11426-5ee6-44f9-a6f0-97dae90162c9 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:16.100622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e11426-5ee6-44f9-a6f0-97dae90162c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:16.120794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-65e11426-5ee6-44f9-a6f0-97dae90162c9 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:16.122021 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-65e11426-5ee6-44f9-a6f0-97dae90162c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:16.130211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1229/2419] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:21:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:21:16.151997 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f613da5-b5d4-42f4-9713-f80d1a8b406d service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:16.163162 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f613da5-b5d4-42f4-9713-f80d1a8b406d service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:16.169276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da319804-ead8-43ce-9800-6cf7ada40469 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:16.169927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da319804-ead8-43ce-9800-6cf7ada40469 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:16.170213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da319804-ead8-43ce-9800-6cf7ada40469 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:16.170493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da319804-ead8-43ce-9800-6cf7ada40469 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:16.179475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da319804-ead8-43ce-9800-6cf7ada40469 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:16.181329 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da319804-ead8-43ce-9800-6cf7ada40469 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:16.192264 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1191/2420] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:21:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:21:20.233062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e22c4-72d5-48f4-a717-418e4b1f8a46 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:20.233591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e22c4-72d5-48f4-a717-418e4b1f8a46 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:20.233709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e22c4-72d5-48f4-a717-418e4b1f8a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:20.251764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e45e22c4-72d5-48f4-a717-418e4b1f8a46 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:20.252971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e45e22c4-72d5-48f4-a717-418e4b1f8a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:20.261572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1230/2421] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:21:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:21:20.282681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da319804-ead8-43ce-9800-6cf7ada40469 service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:20.294111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da319804-ead8-43ce-9800-6cf7ada40469 service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:20.299684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035b4946-8475-41b2-bd81-e6fb1f4494d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:20.300315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b4946-8475-41b2-bd81-e6fb1f4494d4 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:20.300602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b4946-8475-41b2-bd81-e6fb1f4494d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:20.300883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035b4946-8475-41b2-bd81-e6fb1f4494d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:20.309820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b4946-8475-41b2-bd81-e6fb1f4494d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:20.311430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035b4946-8475-41b2-bd81-e6fb1f4494d4 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:20.320779 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1192/2422] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:21:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:21:21.960225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e22c4-72d5-48f4-a717-418e4b1f8a46 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:21.962239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e45e22c4-72d5-48f4-a717-418e4b1f8a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:22.040630 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e22c4-72d5-48f4-a717-418e4b1f8a46 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:22.046116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52714-246e-4599-9dc4-49b6f5aa93e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:22.046772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52714-246e-4599-9dc4-49b6f5aa93e6 service placement] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:22.047096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52714-246e-4599-9dc4-49b6f5aa93e6 service placement] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:22.047378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa52714-246e-4599-9dc4-49b6f5aa93e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:22.049192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-baa52714-246e-4599-9dc4-49b6f5aa93e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:22.061817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa52714-246e-4599-9dc4-49b6f5aa93e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:22.063554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa52714-246e-4599-9dc4-49b6f5aa93e6 service placement] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:22.074090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1231/2423] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:21:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:21:26.451740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e39473-01f5-4048-b845-6babffd781d0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:26.452226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e39473-01f5-4048-b845-6babffd781d0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:26.452226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e39473-01f5-4048-b845-6babffd781d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:26.469911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-31e39473-01f5-4048-b845-6babffd781d0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:26.471150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-31e39473-01f5-4048-b845-6babffd781d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:26.478985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1193/2424] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:21:26.502427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52714-246e-4599-9dc4-49b6f5aa93e6 service placement] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:26.515377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa52714-246e-4599-9dc4-49b6f5aa93e6 service placement] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:26.520880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c84ba-8588-4f07-9e7e-aac5a720634f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:26.521517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c84ba-8588-4f07-9e7e-aac5a720634f service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:26.521807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c84ba-8588-4f07-9e7e-aac5a720634f service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:26.522088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c84ba-8588-4f07-9e7e-aac5a720634f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:26.531132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c84ba-8588-4f07-9e7e-aac5a720634f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:26.532739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533c84ba-8588-4f07-9e7e-aac5a720634f service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:26.542596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1232/2425] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:21:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:21:31.701673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e50a55-3318-4fa1-8247-dc6b26e05300 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:31.702265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e50a55-3318-4fa1-8247-dc6b26e05300 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:31.702265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e50a55-3318-4fa1-8247-dc6b26e05300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:31.721670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-45e50a55-3318-4fa1-8247-dc6b26e05300 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:31.722903 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-45e50a55-3318-4fa1-8247-dc6b26e05300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:31.730876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1194/2426] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:21:31.755531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c84ba-8588-4f07-9e7e-aac5a720634f service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:31.767633 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c84ba-8588-4f07-9e7e-aac5a720634f service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:31.773135 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fa6dc-1004-47cb-b460-3f971884eeb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:31.773773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa6dc-1004-47cb-b460-3f971884eeb0 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:31.774059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa6dc-1004-47cb-b460-3f971884eeb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:31.774339 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fa6dc-1004-47cb-b460-3f971884eeb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:31.783111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fa6dc-1004-47cb-b460-3f971884eeb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:31.784709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fa6dc-1004-47cb-b460-3f971884eeb0 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:31.794869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1233/2427] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:21:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:21:35.133678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e50a55-3318-4fa1-8247-dc6b26e05300 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:21:35.188868 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e50a55-3318-4fa1-8247-dc6b26e05300 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:21:35.192434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711c3e5-d18f-46b0-bc70-2ce556492a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:21:35.193076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c3e5-d18f-46b0-bc70-2ce556492a43 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:35.193356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c3e5-d18f-46b0-bc70-2ce556492a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:35.193629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711c3e5-d18f-46b0-bc70-2ce556492a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:35.203394 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711c3e5-d18f-46b0-bc70-2ce556492a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:21:35.204826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711c3e5-d18f-46b0-bc70-2ce556492a43 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:21:35.215372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1195/2428] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:21:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:21:41.790122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=50 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:45.209991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=44 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:21:50.214644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc02bb4-89ab-4f3a-b4cb-50cf57fccf68 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:21:50.215190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc02bb4-89ab-4f3a-b4cb-50cf57fccf68 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:21:50.215298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc02bb4-89ab-4f3a-b4cb-50cf57fccf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:21:50.232798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-7cc02bb4-89ab-4f3a-b4cb-50cf57fccf68 None None] MFA Rules not processed for user `18d4edc9977444b7940579c8e7477c9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:21:50.233990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7cc02bb4-89ab-4f3a-b4cb-50cf57fccf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:21:50.287268 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1234/2429] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:21:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:22:00.280755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=25 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:22:05.474419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ca1db-0c8f-494f-99b8-d056b41ea633 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:05.474893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ca1db-0c8f-494f-99b8-d056b41ea633 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:05.475007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03ca1db-0c8f-494f-99b8-d056b41ea633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:05.494619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d03ca1db-0c8f-494f-99b8-d056b41ea633 None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:22:05.495883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d03ca1db-0c8f-494f-99b8-d056b41ea633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:05.503215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1196/2430] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:22:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:22:05.543631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc02bb4-89ab-4f3a-b4cb-50cf57fccf68 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:22:05.555838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc02bb4-89ab-4f3a-b4cb-50cf57fccf68 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:22:05.560787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe2f71-d456-4e08-a65d-67a78cda79d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:22:05.561409 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe2f71-d456-4e08-a65d-67a78cda79d2 service swift] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:05.561696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe2f71-d456-4e08-a65d-67a78cda79d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:05.561988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe2f71-d456-4e08-a65d-67a78cda79d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:05.569960 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe2f71-d456-4e08-a65d-67a78cda79d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:22:05.571652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe2f71-d456-4e08-a65d-67a78cda79d2 service swift] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:22:05.579621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1235/2431] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:22:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:22:08.945873 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1301-ff6f-4bad-ab48-c40825ece5d0 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:08.946541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1301-ff6f-4bad-ab48-c40825ece5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:08.946541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a1301-ff6f-4bad-ab48-c40825ece5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:08.966822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-2e5a1301-ff6f-4bad-ab48-c40825ece5d0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:22:08.968075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2e5a1301-ff6f-4bad-ab48-c40825ece5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:08.978148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1197/2432] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:22:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:22:09.005023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe2f71-d456-4e08-a65d-67a78cda79d2 service swift] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:22:09.021948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe2f71-d456-4e08-a65d-67a78cda79d2 service swift] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:22:09.040836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fef3e3-fecf-41b2-876a-9b9b3a71704f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:22:09.041753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fef3e3-fecf-41b2-876a-9b9b3a71704f service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:09.042214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fef3e3-fecf-41b2-876a-9b9b3a71704f service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:09.042499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fef3e3-fecf-41b2-876a-9b9b3a71704f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:09.069217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fef3e3-fecf-41b2-876a-9b9b3a71704f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:22:09.072361 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fef3e3-fecf-41b2-876a-9b9b3a71704f service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:22:09.084426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1236/2433] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:22:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:22:13.359426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2c218-748b-4a93-914e-e64afb85997c None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:13.360382 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2c218-748b-4a93-914e-e64afb85997c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:13.360888 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2c218-748b-4a93-914e-e64afb85997c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:13.380141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-9ff2c218-748b-4a93-914e-e64afb85997c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:22:13.382541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9ff2c218-748b-4a93-914e-e64afb85997c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:13.391402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1198/2434] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:22:13.411969 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fef3e3-fecf-41b2-876a-9b9b3a71704f service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:22:13.428147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fef3e3-fecf-41b2-876a-9b9b3a71704f service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:22:13.434797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdb6ca-c84c-4d2a-95c3-e811de441749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:22:13.435703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb6ca-c84c-4d2a-95c3-e811de441749 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:13.436228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb6ca-c84c-4d2a-95c3-e811de441749 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:13.436723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affdb6ca-c84c-4d2a-95c3-e811de441749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:13.449153 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdb6ca-c84c-4d2a-95c3-e811de441749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:22:13.451219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affdb6ca-c84c-4d2a-95c3-e811de441749 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:22:13.462840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1237/2435] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:22:17.412177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e5138-78a6-4492-b195-f07161d745ba None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:17.412673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e5138-78a6-4492-b195-f07161d745ba None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:17.412790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738e5138-78a6-4492-b195-f07161d745ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:17.432447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-738e5138-78a6-4492-b195-f07161d745ba None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:22:17.433651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-738e5138-78a6-4492-b195-f07161d745ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:17.441829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1199/2436] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:22:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:22:17.474622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdb6ca-c84c-4d2a-95c3-e811de441749 service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:22:17.487166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affdb6ca-c84c-4d2a-95c3-e811de441749 service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:22:17.494018 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7a896-3ee2-4e32-a1aa-e86973183311 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:22:17.494719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7a896-3ee2-4e32-a1aa-e86973183311 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:17.495023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7a896-3ee2-4e32-a1aa-e86973183311 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:17.495308 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a7a896-3ee2-4e32-a1aa-e86973183311 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:17.504817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7a896-3ee2-4e32-a1aa-e86973183311 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:22:17.506709 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a7a896-3ee2-4e32-a1aa-e86973183311 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:22:17.522274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1238/2437] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:22:21.598707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a45c-6ac6-4a4e-af81-aba33faa3d40 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:21.599282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a45c-6ac6-4a4e-af81-aba33faa3d40 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:21.599378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139a45c-6ac6-4a4e-af81-aba33faa3d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:21.620782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d139a45c-6ac6-4a4e-af81-aba33faa3d40 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:22:21.622055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d139a45c-6ac6-4a4e-af81-aba33faa3d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:21.630692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1200/2438] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:22:21.651927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7a896-3ee2-4e32-a1aa-e86973183311 service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:22:21.663833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a7a896-3ee2-4e32-a1aa-e86973183311 service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:22:21.669184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9244b-3edb-4481-86e7-18a465c0e656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:22:21.669816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9244b-3edb-4481-86e7-18a465c0e656 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:21.670099 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9244b-3edb-4481-86e7-18a465c0e656 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:21.670377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9244b-3edb-4481-86e7-18a465c0e656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:21.679534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9244b-3edb-4481-86e7-18a465c0e656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:22:21.681123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9244b-3edb-4481-86e7-18a465c0e656 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:22:21.690915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1239/2439] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:22:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:22:24.213074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175dd83-df3b-43c9-8819-c51d06070080 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:24.213585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175dd83-df3b-43c9-8819-c51d06070080 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:24.213585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5175dd83-df3b-43c9-8819-c51d06070080 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:24.215017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1201/2440] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:22:24.221224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49015d-779a-4b4b-8f15-0406193ae44d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:24.221705 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49015d-779a-4b4b-8f15-0406193ae44d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:24.221816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49015d-779a-4b4b-8f15-0406193ae44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:24.241734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-fa49015d-779a-4b4b-8f15-0406193ae44d None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:22:24.242936 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fa49015d-779a-4b4b-8f15-0406193ae44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:24.252087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1240/2441] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:22:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:22:24.264873 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175dd83-df3b-43c9-8819-c51d06070080 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:22:24.276758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5175dd83-df3b-43c9-8819-c51d06070080 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:22:24.280353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ed7a58-129f-4bc7-9fbe-032c5a0ea780 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210e10ee6b649399de11ac719a89718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:22:24.280984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7a58-129f-4bc7-9fbe-032c5a0ea780 service glance] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:24.281268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7a58-129f-4bc7-9fbe-032c5a0ea780 service glance] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:24.281542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ed7a58-129f-4bc7-9fbe-032c5a0ea780 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:24.292287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7a58-129f-4bc7-9fbe-032c5a0ea780 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:22:24.293732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ed7a58-129f-4bc7-9fbe-032c5a0ea780 service glance] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:22:24.305613 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1202/2442] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:22:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:22:24.374206 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb5a55-305b-48e9-b9ff-1e5cbf15dddc None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:24.374502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb5a55-305b-48e9-b9ff-1e5cbf15dddc None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:24.374785 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bb5a55-305b-48e9-b9ff-1e5cbf15dddc None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:24.376203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1241/2443] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:22:24.380922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40373c57-a396-4df8-9bb6-0fb62d18364b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:24.381209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40373c57-a396-4df8-9bb6-0fb62d18364b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:24.381488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40373c57-a396-4df8-9bb6-0fb62d18364b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:24.400972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-40373c57-a396-4df8-9bb6-0fb62d18364b None None] MFA Rules not processed for user `b3b2d5dee6d240558a71331e05035a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:22:24.402186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-40373c57-a396-4df8-9bb6-0fb62d18364b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:24.409337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1203/2444] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:22:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:22:24.422062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb5a55-305b-48e9-b9ff-1e5cbf15dddc None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:22:24.423805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-79bb5a55-305b-48e9-b9ff-1e5cbf15dddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:24.438214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bb5a55-305b-48e9-b9ff-1e5cbf15dddc None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:22:24.441913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b92b2e-980b-4f8c-a655-cdabefaa9f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:22:24.442560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92b2e-980b-4f8c-a655-cdabefaa9f87 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:24.442851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92b2e-980b-4f8c-a655-cdabefaa9f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:24.443172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b92b2e-980b-4f8c-a655-cdabefaa9f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:24.450683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b92b2e-980b-4f8c-a655-cdabefaa9f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:22:24.452164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b92b2e-980b-4f8c-a655-cdabefaa9f87 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:22:24.460057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1242/2445] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:22:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:22:24.542150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a769b-81d7-48c9-a3a9-7e7fc85dcd23 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:24.542441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a769b-81d7-48c9-a3a9-7e7fc85dcd23 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:24.542744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a769b-81d7-48c9-a3a9-7e7fc85dcd23 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:24.544203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1204/2446] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:22:24.549495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037fa66-ca59-4a5c-83ce-68a173790416 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:24.549781 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037fa66-ca59-4a5c-83ce-68a173790416 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:24.550060 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2037fa66-ca59-4a5c-83ce-68a173790416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:24.570045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2037fa66-ca59-4a5c-83ce-68a173790416 None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:22:24.571274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2037fa66-ca59-4a5c-83ce-68a173790416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:24.580476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1243/2447] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:22:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:22:24.590941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a769b-81d7-48c9-a3a9-7e7fc85dcd23 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:22:24.602580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a769b-81d7-48c9-a3a9-7e7fc85dcd23 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:22:24.606206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b546e5-935c-4c4e-8e5f-fd471ba7ee14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:22:24.606854 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b546e5-935c-4c4e-8e5f-fd471ba7ee14 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:24.607213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b546e5-935c-4c4e-8e5f-fd471ba7ee14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:24.607488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b546e5-935c-4c4e-8e5f-fd471ba7ee14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:24.618626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b546e5-935c-4c4e-8e5f-fd471ba7ee14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:22:24.620095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b546e5-935c-4c4e-8e5f-fd471ba7ee14 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:22:24.630942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1205/2448] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:22:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:22:25.816032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12a3fe-8dfe-4547-8363-27e49bc3cf1d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:25.816544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12a3fe-8dfe-4547-8363-27e49bc3cf1d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:25.816653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad12a3fe-8dfe-4547-8363-27e49bc3cf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:25.834516 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ad12a3fe-8dfe-4547-8363-27e49bc3cf1d None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:22:25.836410 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ad12a3fe-8dfe-4547-8363-27e49bc3cf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:25.844618 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1244/2449] 10.222.0.49 () {58 vars in 1016 bytes} [Thu Jul 21 04:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:22:25.866177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b546e5-935c-4c4e-8e5f-fd471ba7ee14 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:22:25.878470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b546e5-935c-4c4e-8e5f-fd471ba7ee14 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:22:25.885505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6811-1aae-44ef-9c9a-a93d713e4976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:22:25.886151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6811-1aae-44ef-9c9a-a93d713e4976 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:25.886572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6811-1aae-44ef-9c9a-a93d713e4976 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:25.886781 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196b6811-1aae-44ef-9c9a-a93d713e4976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:25.895622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6811-1aae-44ef-9c9a-a93d713e4976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:22:25.897810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196b6811-1aae-44ef-9c9a-a93d713e4976 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:22:25.907608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1206/2450] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:22:29.255521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d178df-3069-4050-80cb-b1d38280626c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:29.255971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d178df-3069-4050-80cb-b1d38280626c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:29.256078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d178df-3069-4050-80cb-b1d38280626c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:29.273831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-f8d178df-3069-4050-80cb-b1d38280626c None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:22:29.275072 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f8d178df-3069-4050-80cb-b1d38280626c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:22:29.282162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1245/2451] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:22:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:22:29.294481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6811-1aae-44ef-9c9a-a93d713e4976 service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:22:29.306397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196b6811-1aae-44ef-9c9a-a93d713e4976 service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:22:29.317365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a3b8a6-8b40-44de-aae6-1cba8f515727 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:22:29.318041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b8a6-8b40-44de-aae6-1cba8f515727 service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:22:29.318332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b8a6-8b40-44de-aae6-1cba8f515727 service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:22:29.318940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a3b8a6-8b40-44de-aae6-1cba8f515727 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:22:29.328070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3b8a6-8b40-44de-aae6-1cba8f515727 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:22:29.329652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a3b8a6-8b40-44de-aae6-1cba8f515727 service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:22:29.338393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1207/2452] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:22:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:22:39.268248 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=48 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:22:39.335513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=42 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:23:00.388628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dd634-5cb0-46fa-a2dc-1ceb0d6f4f79 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:00.389186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dd634-5cb0-46fa-a2dc-1ceb0d6f4f79 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:00.389186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2dd634-5cb0-46fa-a2dc-1ceb0d6f4f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:00.407230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-0a2dd634-5cb0-46fa-a2dc-1ceb0d6f4f79 None None] MFA Rules not processed for user `9b6716c39cc74e3c8b3949773023c2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:23:00.408453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0a2dd634-5cb0-46fa-a2dc-1ceb0d6f4f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:00.463931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1246/2453] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:23:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:23:02.097671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c50d-97b1-438b-95d1-15231ad9cb1b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:02.098193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c50d-97b1-438b-95d1-15231ad9cb1b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:02.098386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c50d-97b1-438b-95d1-15231ad9cb1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:02.133257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-b946c50d-97b1-438b-95d1-15231ad9cb1b None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:23:02.135377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b946c50d-97b1-438b-95d1-15231ad9cb1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:02.156039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1208/2454] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 21 04:23:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:23:02.165163 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dd634-5cb0-46fa-a2dc-1ceb0d6f4f79 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:02.180797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2dd634-5cb0-46fa-a2dc-1ceb0d6f4f79 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:02.186471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634e6ff-af38-4f18-a77a-a351a5737ed5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:02.186912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634e6ff-af38-4f18-a77a-a351a5737ed5 service swift] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:02.187328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634e6ff-af38-4f18-a77a-a351a5737ed5 service swift] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:02.187673 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2634e6ff-af38-4f18-a77a-a351a5737ed5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:02.197552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634e6ff-af38-4f18-a77a-a351a5737ed5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:02.199282 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2634e6ff-af38-4f18-a77a-a351a5737ed5 service swift] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:02.208169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1247/2455] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:23:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:23:10.960169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c50d-97b1-438b-95d1-15231ad9cb1b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:10.976774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c50d-97b1-438b-95d1-15231ad9cb1b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:10.996881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb5168-def5-40b8-bcb5-9c5da60adb0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:10.998073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5168-def5-40b8-bcb5-9c5da60adb0f service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:10.998859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5168-def5-40b8-bcb5-9c5da60adb0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:10.999589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb5168-def5-40b8-bcb5-9c5da60adb0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:11.001759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f0cb5168-def5-40b8-bcb5-9c5da60adb0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:11.017732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb5168-def5-40b8-bcb5-9c5da60adb0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:11.019353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb5168-def5-40b8-bcb5-9c5da60adb0f service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:11.032316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1209/2456] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:23:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:23:12.204532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=31 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:23:12.239046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634e6ff-af38-4f18-a77a-a351a5737ed5 service swift] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:12.249560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2634e6ff-af38-4f18-a77a-a351a5737ed5 service swift] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:12.253284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4ca8-23b0-43bf-aa6d-cc9d00d86520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:12.253862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4ca8-23b0-43bf-aa6d-cc9d00d86520 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:12.254145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4ca8-23b0-43bf-aa6d-cc9d00d86520 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:12.254417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec4ca8-23b0-43bf-aa6d-cc9d00d86520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:12.256894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-daec4ca8-23b0-43bf-aa6d-cc9d00d86520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:12.271503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec4ca8-23b0-43bf-aa6d-cc9d00d86520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:12.273121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec4ca8-23b0-43bf-aa6d-cc9d00d86520 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:12.285831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1248/2457] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:23:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:23:16.246378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4975b-6a38-476b-993d-29417da8961b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:16.246873 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4975b-6a38-476b-993d-29417da8961b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:16.247271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4975b-6a38-476b-993d-29417da8961b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:16.264908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-2ff4975b-6a38-476b-993d-29417da8961b None None] MFA Rules not processed for user `94d0ed0857064f368e9f09b434bf93fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:23:16.266136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2ff4975b-6a38-476b-993d-29417da8961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:16.274339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1210/2458] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:23:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:23:21.532365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4ca8-23b0-43bf-aa6d-cc9d00d86520 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:21.544167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec4ca8-23b0-43bf-aa6d-cc9d00d86520 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:21.550491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce486e3c-e176-4fa4-b667-8c41c5a2a22d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:21.551461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486e3c-e176-4fa4-b667-8c41c5a2a22d service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:21.551567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486e3c-e176-4fa4-b667-8c41c5a2a22d service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:21.552058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce486e3c-e176-4fa4-b667-8c41c5a2a22d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:21.553843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ce486e3c-e176-4fa4-b667-8c41c5a2a22d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:21.564520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce486e3c-e176-4fa4-b667-8c41c5a2a22d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:21.566111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce486e3c-e176-4fa4-b667-8c41c5a2a22d service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:21.575956 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1249/2459] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:23:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:23:24.489898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4975b-6a38-476b-993d-29417da8961b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:24.491408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2ff4975b-6a38-476b-993d-29417da8961b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:23:24.505468 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4975b-6a38-476b-993d-29417da8961b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:24.510072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:24.510970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:24.511267 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:24.511547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] PATH_INFO: `/v3/users/18d4edc9977444b7940579c8e7477c9c` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:24.512862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] RBAC: Authorizing `identity:delete_user(user_id=18d4edc9977444b7940579c8e7477c9c)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:24.514853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:24.561010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18d4edc9977444b7940579c8e7477c9c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:23:24.561654 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18d4edc9977444b7940579c8e7477c9c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:23:24.562278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18d4edc9977444b7940579c8e7477c9c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:23:24.569146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18d4edc9977444b7940579c8e7477c9c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:23:24.576379 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18d4edc9977444b7940579c8e7477c9c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:23:24.594472 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1211/2460] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:23:24 2022] DELETE /identity/v3/users/18d4edc9977444b7940579c8e7477c9c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:23:24.769439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce486e3c-e176-4fa4-b667-8c41c5a2a22d service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:23:24.784446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce486e3c-e176-4fa4-b667-8c41c5a2a22d service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:23:24.847338 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:23:24.848477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:23:24.848603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:23:24.848793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] PATH_INFO: `/v3/projects/0e56f4657b9d4006bac8147212c13895` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:23:24.849987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e56f4657b9d4006bac8147212c13895)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:23:24.851973 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:23:24.901928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e56f4657b9d4006bac8147212c13895', 'request_id': 'req-1ce4d519-08ad-4117-bb20-48a97819add8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:23:24.909790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e56f4657b9d4006bac8147212c13895', 'request_id': 'req-1ce4d519-08ad-4117-bb20-48a97819add8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:23:24.916216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e56f4657b9d4006bac8147212c13895', 'request_id': 'req-1ce4d519-08ad-4117-bb20-48a97819add8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:23:24.928198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] The token cache is being invalidate because project 0e56f4657b9d4006bac8147212c13895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:23:24.928489 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:23:24.929140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:23:24.930663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1250/2461] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:23:24 2022] DELETE /identity/v3/projects/0e56f4657b9d4006bac8147212c13895 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:23:34.590878 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=41,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:23:34.924715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:10.240385 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:10.241949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:10.300717 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82307362-c0fc-405c-8d22-28c21d9e912c admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:10.351534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fea5d-d99c-4706-95e5-65a85efd7638 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:10.352181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fea5d-d99c-4706-95e5-65a85efd7638 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:10.352461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fea5d-d99c-4706-95e5-65a85efd7638 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:10.352733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85fea5d-d99c-4706-95e5-65a85efd7638 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:10.355317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b85fea5d-d99c-4706-95e5-65a85efd7638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:10.366322 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fea5d-d99c-4706-95e5-65a85efd7638 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:10.367799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85fea5d-d99c-4706-95e5-65a85efd7638 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:10.376518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1212/2462] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:15.000790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:15.002357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:15.104989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4d519-08ad-4117-bb20-48a97819add8 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:15.111207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207f5ba4-2613-4b18-8214-b90c46051fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:15.112089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f5ba4-2613-4b18-8214-b90c46051fc6 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:15.112386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f5ba4-2613-4b18-8214-b90c46051fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:15.112728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207f5ba4-2613-4b18-8214-b90c46051fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:15.115593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-207f5ba4-2613-4b18-8214-b90c46051fc6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:15.130989 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f5ba4-2613-4b18-8214-b90c46051fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:15.132676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207f5ba4-2613-4b18-8214-b90c46051fc6 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:15.147556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1251/2463] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:15.628118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fea5d-d99c-4706-95e5-65a85efd7638 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:15.630196 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b85fea5d-d99c-4706-95e5-65a85efd7638 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:15.687858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85fea5d-d99c-4706-95e5-65a85efd7638 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:15.692518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdadead-e196-4238-a72b-d79c71262885 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:15.693165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdadead-e196-4238-a72b-d79c71262885 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:15.693445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdadead-e196-4238-a72b-d79c71262885 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:15.693720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdadead-e196-4238-a72b-d79c71262885 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:15.695513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6bdadead-e196-4238-a72b-d79c71262885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:15.756130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdadead-e196-4238-a72b-d79c71262885 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:15.757615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdadead-e196-4238-a72b-d79c71262885 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:15.767443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1213/2464] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:24:18.797965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c18d01-0519-47e9-bb8e-63acfe8b7d1c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:18.798463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c18d01-0519-47e9-bb8e-63acfe8b7d1c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:18.798582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c18d01-0519-47e9-bb8e-63acfe8b7d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:18.816413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-c6c18d01-0519-47e9-bb8e-63acfe8b7d1c None None] MFA Rules not processed for user `1b6a94234c2d44da86811f825ec21f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:24:18.817707 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c6c18d01-0519-47e9-bb8e-63acfe8b7d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:18.872510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1252/2465] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:24:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:24:19.178734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdadead-e196-4238-a72b-d79c71262885 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:19.180228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6bdadead-e196-4238-a72b-d79c71262885 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:19.192582 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdadead-e196-4238-a72b-d79c71262885 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:19.196190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680778e-b5f5-4016-bfc1-26d4f58ef2b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:19.196831 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680778e-b5f5-4016-bfc1-26d4f58ef2b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:19.197119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680778e-b5f5-4016-bfc1-26d4f58ef2b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:19.197400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b680778e-b5f5-4016-bfc1-26d4f58ef2b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:19.199208 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b680778e-b5f5-4016-bfc1-26d4f58ef2b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:19.208850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680778e-b5f5-4016-bfc1-26d4f58ef2b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:19.210300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b680778e-b5f5-4016-bfc1-26d4f58ef2b8 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:19.215435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:19.219641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1214/2466] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:19.531834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c18d01-0519-47e9-bb8e-63acfe8b7d1c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:19.533239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c6c18d01-0519-47e9-bb8e-63acfe8b7d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:19.608671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c18d01-0519-47e9-bb8e-63acfe8b7d1c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:19.614677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a34b1-6407-4901-a8ed-b0a57f8b313a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:19.615368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a34b1-6407-4901-a8ed-b0a57f8b313a service placement] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:19.615654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a34b1-6407-4901-a8ed-b0a57f8b313a service placement] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:19.615934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a34b1-6407-4901-a8ed-b0a57f8b313a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:19.617726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ec8a34b1-6407-4901-a8ed-b0a57f8b313a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:19.629353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a34b1-6407-4901-a8ed-b0a57f8b313a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:19.630884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8a34b1-6407-4901-a8ed-b0a57f8b313a service placement] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:19.641042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1253/2467] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:24.607959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680778e-b5f5-4016-bfc1-26d4f58ef2b8 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:24.610162 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b680778e-b5f5-4016-bfc1-26d4f58ef2b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:24.647857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b680778e-b5f5-4016-bfc1-26d4f58ef2b8 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:24.658456 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64757c-d54f-4565-a973-f734c68bfd25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:24.666016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64757c-d54f-4565-a973-f734c68bfd25 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:24.666622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64757c-d54f-4565-a973-f734c68bfd25 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:24.667413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be64757c-d54f-4565-a973-f734c68bfd25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:24.670747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-be64757c-d54f-4565-a973-f734c68bfd25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:24.698226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64757c-d54f-4565-a973-f734c68bfd25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:24.699962 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be64757c-d54f-4565-a973-f734c68bfd25 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:24.728594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1215/2468] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:29.636560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=91 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:33.220577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a34b1-6407-4901-a8ed-b0a57f8b313a service placement] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:33.233574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a34b1-6407-4901-a8ed-b0a57f8b313a service placement] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:33.240054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048ab798-fa5d-458b-8282-6b68668b2810 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:33.240713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ab798-fa5d-458b-8282-6b68668b2810 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:33.240988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ab798-fa5d-458b-8282-6b68668b2810 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:33.241266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048ab798-fa5d-458b-8282-6b68668b2810 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:33.243037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-048ab798-fa5d-458b-8282-6b68668b2810 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:33.256232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ab798-fa5d-458b-8282-6b68668b2810 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:33.257826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048ab798-fa5d-458b-8282-6b68668b2810 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:33.268696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1254/2469] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:33.906198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64757c-d54f-4565-a973-f734c68bfd25 service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:33.918349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be64757c-d54f-4565-a973-f734c68bfd25 service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:33.923817 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c72dc-c364-44a2-b99f-18a956e6aaaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:33.924451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c72dc-c364-44a2-b99f-18a956e6aaaa service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:33.924736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c72dc-c364-44a2-b99f-18a956e6aaaa service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:33.925749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088c72dc-c364-44a2-b99f-18a956e6aaaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:33.927667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-088c72dc-c364-44a2-b99f-18a956e6aaaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:33.937924 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c72dc-c364-44a2-b99f-18a956e6aaaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:33.939550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088c72dc-c364-44a2-b99f-18a956e6aaaa service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:33.948588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1216/2470] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:34.597611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d574ae-2542-4357-bd0e-9aba2ffbd510 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:34.598113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d574ae-2542-4357-bd0e-9aba2ffbd510 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:34.598215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d574ae-2542-4357-bd0e-9aba2ffbd510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:34.616224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-03d574ae-2542-4357-bd0e-9aba2ffbd510 None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:24:34.617417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-03d574ae-2542-4357-bd0e-9aba2ffbd510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:34.674254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1255/2471] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 21 04:24:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:24:34.721074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c72dc-c364-44a2-b99f-18a956e6aaaa service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:34.722503 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-088c72dc-c364-44a2-b99f-18a956e6aaaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:34.790419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088c72dc-c364-44a2-b99f-18a956e6aaaa service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:34.795497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca08ae-4543-4f2f-8eae-c7f3257a949e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:34.796140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca08ae-4543-4f2f-8eae-c7f3257a949e service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:34.796432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca08ae-4543-4f2f-8eae-c7f3257a949e service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:34.796712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca08ae-4543-4f2f-8eae-c7f3257a949e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:34.805118 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca08ae-4543-4f2f-8eae-c7f3257a949e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:34.806711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca08ae-4543-4f2f-8eae-c7f3257a949e service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:34.814635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1217/2472] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:24:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:24:39.142253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d9f3-a883-43e1-8c8f-5a2aaf90e161 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:39.143140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d9f3-a883-43e1-8c8f-5a2aaf90e161 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:39.144173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8463d9f3-a883-43e1-8c8f-5a2aaf90e161 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:39.145740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1256/2473] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:24:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:24:39.178213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130a05a-33bd-4c81-b28d-510d21ba52d5 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:39.178794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130a05a-33bd-4c81-b28d-510d21ba52d5 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:39.178794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0130a05a-33bd-4c81-b28d-510d21ba52d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:39.211901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-0130a05a-33bd-4c81-b28d-510d21ba52d5 None None] MFA Rules not processed for user `8572e4c550014fc4b1aea3ddf16f7d2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:24:39.214016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0130a05a-33bd-4c81-b28d-510d21ba52d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:39.243294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1218/2474] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:24:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:24:39.261701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d9f3-a883-43e1-8c8f-5a2aaf90e161 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:39.286576 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8463d9f3-a883-43e1-8c8f-5a2aaf90e161 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:39.293070 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8916c3-75f6-4f64-97d0-9aaf14de69e3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:39.294095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8916c3-75f6-4f64-97d0-9aaf14de69e3 service placement] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:39.294538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8916c3-75f6-4f64-97d0-9aaf14de69e3 service placement] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:39.294991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8916c3-75f6-4f64-97d0-9aaf14de69e3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:39.311440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8916c3-75f6-4f64-97d0-9aaf14de69e3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:39.313295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8916c3-75f6-4f64-97d0-9aaf14de69e3 service placement] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:39.325548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1257/2475] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:24:40.163692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130a05a-33bd-4c81-b28d-510d21ba52d5 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:40.165211 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0130a05a-33bd-4c81-b28d-510d21ba52d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:40.178282 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0130a05a-33bd-4c81-b28d-510d21ba52d5 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:40.182826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c46fc-08b9-4c1b-9b8e-3ddad81ca9c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:40.183783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c46fc-08b9-4c1b-9b8e-3ddad81ca9c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:40.184273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c46fc-08b9-4c1b-9b8e-3ddad81ca9c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:40.184746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c46fc-08b9-4c1b-9b8e-3ddad81ca9c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:40.187033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-076c46fc-08b9-4c1b-9b8e-3ddad81ca9c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:40.277041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c46fc-08b9-4c1b-9b8e-3ddad81ca9c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:40.278509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c46fc-08b9-4c1b-9b8e-3ddad81ca9c6 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:40.289852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1219/2476] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:42.803500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8916c3-75f6-4f64-97d0-9aaf14de69e3 service placement] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:42.805512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8c8916c3-75f6-4f64-97d0-9aaf14de69e3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:42.826828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8916c3-75f6-4f64-97d0-9aaf14de69e3 service placement] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:42.834217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:42.835556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:42.836042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:42.836837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] PATH_INFO: `/v3/users/84dce5bebadc4b1bb3403132a0767ed8` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:42.838610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=84dce5bebadc4b1bb3403132a0767ed8)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:42.842537 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:42.914386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84dce5bebadc4b1bb3403132a0767ed8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:42.915095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84dce5bebadc4b1bb3403132a0767ed8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:42.915704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84dce5bebadc4b1bb3403132a0767ed8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:42.924097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84dce5bebadc4b1bb3403132a0767ed8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:42.933743 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84dce5bebadc4b1bb3403132a0767ed8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:42.958703 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1258/2477] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:24:42 2022] DELETE /identity/v3/users/84dce5bebadc4b1bb3403132a0767ed8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:24:43.167183 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c46fc-08b9-4c1b-9b8e-3ddad81ca9c6 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:43.188537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c46fc-08b9-4c1b-9b8e-3ddad81ca9c6 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:43.248203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:43.258621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:43.259573 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:43.259859 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:43.260136 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] PATH_INFO: `/v3/projects/0f7615e1d2824c6487d89f0a64bc6fbc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:43.261338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7615e1d2824c6487d89f0a64bc6fbc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:43.263283 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:43.311102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7615e1d2824c6487d89f0a64bc6fbc', 'request_id': 'req-100bde58-9a9a-4768-ab0b-32bb9c5b6794'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.319624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7615e1d2824c6487d89f0a64bc6fbc', 'request_id': 'req-100bde58-9a9a-4768-ab0b-32bb9c5b6794'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.325383 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7615e1d2824c6487d89f0a64bc6fbc', 'request_id': 'req-100bde58-9a9a-4768-ab0b-32bb9c5b6794'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.337899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] The token cache is being invalidate because project 0f7615e1d2824c6487d89f0a64bc6fbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:24:43.338113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.338751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.340569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1220/2478] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:24:43 2022] DELETE /identity/v3/projects/0f7615e1d2824c6487d89f0a64bc6fbc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:24:43.344549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:43.346009 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:43.360787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54061548-0bd8-4c92-89d3-384b76b02a6a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:43.411250 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:43.423626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:43.424571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:43.424905 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:43.425184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] PATH_INFO: `/v3/users/b21b9d87e6864762b90a610270182263` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:43.426441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b21b9d87e6864762b90a610270182263)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:43.428602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:43.480521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b21b9d87e6864762b90a610270182263'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.481184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b21b9d87e6864762b90a610270182263'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.481807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b21b9d87e6864762b90a610270182263'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.489337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b21b9d87e6864762b90a610270182263'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.498831 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b21b9d87e6864762b90a610270182263'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.520335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1259/2479] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:24:43 2022] DELETE /identity/v3/users/b21b9d87e6864762b90a610270182263 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:24:43.725516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:43.727305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:43.749682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100bde58-9a9a-4768-ab0b-32bb9c5b6794 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:43.811933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:43.812922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:43.813269 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:43.813612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] PATH_INFO: `/v3/projects/a556dba66e3442d0a7c95aeabaa249bc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:43.815457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a556dba66e3442d0a7c95aeabaa249bc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:43.817398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:43.866166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a556dba66e3442d0a7c95aeabaa249bc', 'request_id': 'req-7beb5de1-2511-490c-8948-dd999f6bc67f'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.874989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a556dba66e3442d0a7c95aeabaa249bc', 'request_id': 'req-7beb5de1-2511-490c-8948-dd999f6bc67f'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.881109 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a556dba66e3442d0a7c95aeabaa249bc', 'request_id': 'req-7beb5de1-2511-490c-8948-dd999f6bc67f'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.893141 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] The token cache is being invalidate because project a556dba66e3442d0a7c95aeabaa249bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:24:43.893479 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.894168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:43.895756 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1221/2480] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:24:43 2022] DELETE /identity/v3/projects/a556dba66e3442d0a7c95aeabaa249bc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:24:44.519788 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:44.521271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:44.584127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:44.586159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:44.598653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0657e-ccd5-4e14-ae36-9b86a7c52b6d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:44.603073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:44.658147 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beb5de1-2511-490c-8948-dd999f6bc67f admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:44.662860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ab04c-df2b-4d21-8bdf-11750460af04 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:44.663550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ab04c-df2b-4d21-8bdf-11750460af04 service placement] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:44.663656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:44.663836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ab04c-df2b-4d21-8bdf-11750460af04 service placement] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:44.664144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ab04c-df2b-4d21-8bdf-11750460af04 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:44.664733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:44.665053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:44.665400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] PATH_INFO: `/v3/users/9b6716c39cc74e3c8b3949773023c2f5` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:44.666182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-505ab04c-df2b-4d21-8bdf-11750460af04 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:44.666656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b6716c39cc74e3c8b3949773023c2f5)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:44.668956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:44.678469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ab04c-df2b-4d21-8bdf-11750460af04 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:44.680093 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ab04c-df2b-4d21-8bdf-11750460af04 service placement] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:44.690293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1260/2481] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:24:44.719965 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b6716c39cc74e3c8b3949773023c2f5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:44.720636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b6716c39cc74e3c8b3949773023c2f5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:44.722165 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b6716c39cc74e3c8b3949773023c2f5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:44.729545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b6716c39cc74e3c8b3949773023c2f5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:44.736748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-1353f1a3-6377-4ebf-b039-c55187ceec50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b6716c39cc74e3c8b3949773023c2f5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:44.754326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1222/2482] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:24:44 2022] DELETE /identity/v3/users/9b6716c39cc74e3c8b3949773023c2f5 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:24:44.928809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ab04c-df2b-4d21-8bdf-11750460af04 service placement] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:44.935011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:44.943685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ab04c-df2b-4d21-8bdf-11750460af04 service placement] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:45.003681 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:45.004513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.004798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.005072 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] PATH_INFO: `/v3/projects/b8ba79f7b1fd43a298d56a2396ecf3d6` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.006246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ba79f7b1fd43a298d56a2396ecf3d6)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:45.008197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:45.053283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ba79f7b1fd43a298d56a2396ecf3d6', 'request_id': 'req-1b7abd8c-910c-415d-b943-fac80a61e0aa'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:45.059584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ba79f7b1fd43a298d56a2396ecf3d6', 'request_id': 'req-1b7abd8c-910c-415d-b943-fac80a61e0aa'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:45.065503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ba79f7b1fd43a298d56a2396ecf3d6', 'request_id': 'req-1b7abd8c-910c-415d-b943-fac80a61e0aa'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:45.076350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] The token cache is being invalidate because project b8ba79f7b1fd43a298d56a2396ecf3d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:24:45.076663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:45.077306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-1b7abd8c-910c-415d-b943-fac80a61e0aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:24:45.078855 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1261/2483] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:24:44 2022] DELETE /identity/v3/projects/b8ba79f7b1fd43a298d56a2396ecf3d6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:24:45.084627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983619a-92a5-40d7-9188-265cb846c4e6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.084916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983619a-92a5-40d7-9188-265cb846c4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.085198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983619a-92a5-40d7-9188-265cb846c4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.103515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-4983619a-92a5-40d7-9188-265cb846c4e6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:24:45.104704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4983619a-92a5-40d7-9188-265cb846c4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:45.165055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1223/2484] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:24:45.172894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6a095-7a1f-41e7-87c7-5f9d9c328438 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.173121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6a095-7a1f-41e7-87c7-5f9d9c328438 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.173396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b6a095-7a1f-41e7-87c7-5f9d9c328438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.192235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-57b6a095-7a1f-41e7-87c7-5f9d9c328438 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:24:45.193428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-57b6a095-7a1f-41e7-87c7-5f9d9c328438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:45.201230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1262/2485] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:24:45.205928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983619a-92a5-40d7-9188-265cb846c4e6 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:45.215595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983619a-92a5-40d7-9188-265cb846c4e6 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:45.220064 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b963f4-dc9c-4fa6-9d3a-b1be1bbec300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:45.220706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b963f4-dc9c-4fa6-9d3a-b1be1bbec300 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.221580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b963f4-dc9c-4fa6-9d3a-b1be1bbec300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.221855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b963f4-dc9c-4fa6-9d3a-b1be1bbec300 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.222578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b963f4-dc9c-4fa6-9d3a-b1be1bbec300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:24:45.222882 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b963f4-dc9c-4fa6-9d3a-b1be1bbec300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:45.224512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b963f4-dc9c-4fa6-9d3a-b1be1bbec300 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:45.235741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1224/2486] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:24:45.240110 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6a095-7a1f-41e7-87c7-5f9d9c328438 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:45.249233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b6a095-7a1f-41e7-87c7-5f9d9c328438 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:45.253848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25ea17-e3df-4a2f-a345-9f1f635cdd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:45.254484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25ea17-e3df-4a2f-a345-9f1f635cdd89 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.254900 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25ea17-e3df-4a2f-a345-9f1f635cdd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.255209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a25ea17-e3df-4a2f-a345-9f1f635cdd89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.255899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25ea17-e3df-4a2f-a345-9f1f635cdd89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:45.257798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a25ea17-e3df-4a2f-a345-9f1f635cdd89 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:45.284189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1263/2487] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:24:45 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:24:45.288170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b963f4-dc9c-4fa6-9d3a-b1be1bbec300 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:45.298252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b963f4-dc9c-4fa6-9d3a-b1be1bbec300 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:45.311559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:45.357974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c691fa-b042-4661-8938-95925bde2597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:45.358638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c691fa-b042-4661-8938-95925bde2597 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.358930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c691fa-b042-4661-8938-95925bde2597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.359252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c691fa-b042-4661-8938-95925bde2597 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.359949 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c691fa-b042-4661-8938-95925bde2597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:45.362612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c691fa-b042-4661-8938-95925bde2597 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:45.382946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1225/2488] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:24:45 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:24:45.387208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25ea17-e3df-4a2f-a345-9f1f635cdd89 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:45.397764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a25ea17-e3df-4a2f-a345-9f1f635cdd89 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:45.402363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ede42a-e056-4c2e-9bd9-7fd40078ba23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:45.403055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ede42a-e056-4c2e-9bd9-7fd40078ba23 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.403346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ede42a-e056-4c2e-9bd9-7fd40078ba23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.403627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ede42a-e056-4c2e-9bd9-7fd40078ba23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.404353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ede42a-e056-4c2e-9bd9-7fd40078ba23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:45.406241 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ede42a-e056-4c2e-9bd9-7fd40078ba23 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:45.416734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1264/2489] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:24:45.420812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c691fa-b042-4661-8938-95925bde2597 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:45.432303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c691fa-b042-4661-8938-95925bde2597 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:45.436885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999bad09-df92-4188-93da-815373888044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:45.437539 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bad09-df92-4188-93da-815373888044 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.437824 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bad09-df92-4188-93da-815373888044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.438098 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999bad09-df92-4188-93da-815373888044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.438818 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bad09-df92-4188-93da-815373888044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:45.441046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999bad09-df92-4188-93da-815373888044 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:45.450907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1226/2490] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:24:45.455159 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ede42a-e056-4c2e-9bd9-7fd40078ba23 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:45.465386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ede42a-e056-4c2e-9bd9-7fd40078ba23 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:45.470506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca935f-8c6a-4ec2-8cf1-0bbb796041ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:45.471951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca935f-8c6a-4ec2-8cf1-0bbb796041ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.472261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca935f-8c6a-4ec2-8cf1-0bbb796041ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.472553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dca935f-8c6a-4ec2-8cf1-0bbb796041ce admin admin] PATH_INFO: `/v3/projects/38b2bf3d833645fa9314ec5277474ac0/users/eeba43224b9240f8b0dfbf9c47a234e4/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.488802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca935f-8c6a-4ec2-8cf1-0bbb796041ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=38b2bf3d833645fa9314ec5277474ac0, user_id=eeba43224b9240f8b0dfbf9c47a234e4, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:45.491581 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dca935f-8c6a-4ec2-8cf1-0bbb796041ce admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:45.506440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1265/2491] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:24:45 2022] PUT /identity/v3/projects/38b2bf3d833645fa9314ec5277474ac0/users/eeba43224b9240f8b0dfbf9c47a234e4/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:24:45.511408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f61fe-ba52-4235-81b0-e6076129fe6b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.511699 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f61fe-ba52-4235-81b0-e6076129fe6b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.511979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f61fe-ba52-4235-81b0-e6076129fe6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.530391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-0a3f61fe-ba52-4235-81b0-e6076129fe6b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:24:45.531650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0a3f61fe-ba52-4235-81b0-e6076129fe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:45.592629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1227/2492] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:24:45.602776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca935f-8c6a-4ec2-8cf1-0bbb796041ce admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:45.604490 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3dca935f-8c6a-4ec2-8cf1-0bbb796041ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:45.637406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:45.664335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dca935f-8c6a-4ec2-8cf1-0bbb796041ce admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:45.668287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337c60-9810-444e-aaa5-4f7d1d9f677f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:45.668938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337c60-9810-444e-aaa5-4f7d1d9f677f service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:45.669223 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337c60-9810-444e-aaa5-4f7d1d9f677f service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:45.669556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40337c60-9810-444e-aaa5-4f7d1d9f677f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:45.679405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40337c60-9810-444e-aaa5-4f7d1d9f677f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:45.680852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40337c60-9810-444e-aaa5-4f7d1d9f677f service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:45.690830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1266/2493] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:49.495690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266af50f-1534-4fb8-afed-da55a41318eb None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:49.496151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266af50f-1534-4fb8-afed-da55a41318eb None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:49.496425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266af50f-1534-4fb8-afed-da55a41318eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:49.529508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-266af50f-1534-4fb8-afed-da55a41318eb None None] MFA Rules not processed for user `eeba43224b9240f8b0dfbf9c47a234e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:24:49.530807 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-266af50f-1534-4fb8-afed-da55a41318eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:49.606980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1228/2494] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:24:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:24:49.624547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337c60-9810-444e-aaa5-4f7d1d9f677f service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:49.627252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-40337c60-9810-444e-aaa5-4f7d1d9f677f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:49.731872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40337c60-9810-444e-aaa5-4f7d1d9f677f service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:49.738094 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467415d9-036d-4e1c-bf1b-8beea0cf64d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:49.738753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467415d9-036d-4e1c-bf1b-8beea0cf64d3 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:49.739076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467415d9-036d-4e1c-bf1b-8beea0cf64d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:49.739358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467415d9-036d-4e1c-bf1b-8beea0cf64d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:49.748963 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467415d9-036d-4e1c-bf1b-8beea0cf64d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:49.751574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467415d9-036d-4e1c-bf1b-8beea0cf64d3 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:49.762524 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1267/2495] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:51.187743 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c36d7-a440-47c9-aa8c-0d21455f7acc None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:51.188245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c36d7-a440-47c9-aa8c-0d21455f7acc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:51.188343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c36d7-a440-47c9-aa8c-0d21455f7acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:51.211065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-987c36d7-a440-47c9-aa8c-0d21455f7acc None None] MFA Rules not processed for user `eeba43224b9240f8b0dfbf9c47a234e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:24:51.212410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-987c36d7-a440-47c9-aa8c-0d21455f7acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:51.219509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1229/2496] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:24:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:24:51.553359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467415d9-036d-4e1c-bf1b-8beea0cf64d3 service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:24:51.563506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467415d9-036d-4e1c-bf1b-8beea0cf64d3 service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:24:51.568974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d4bb88-3f93-45a2-8fec-9ef3b444ff41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:24:51.569632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4bb88-3f93-45a2-8fec-9ef3b444ff41 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:51.569911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4bb88-3f93-45a2-8fec-9ef3b444ff41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:51.570188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d4bb88-3f93-45a2-8fec-9ef3b444ff41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:51.572069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e7d4bb88-3f93-45a2-8fec-9ef3b444ff41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:51.586717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4bb88-3f93-45a2-8fec-9ef3b444ff41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:24:51.588240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d4bb88-3f93-45a2-8fec-9ef3b444ff41 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:24:51.599614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1268/2497] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:24:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:24:58.917193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02895869-b38f-445b-a4fa-fb85a9c9cfea None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:24:58.917739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02895869-b38f-445b-a4fa-fb85a9c9cfea None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:24:58.917739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02895869-b38f-445b-a4fa-fb85a9c9cfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:24:58.937120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-02895869-b38f-445b-a4fa-fb85a9c9cfea None None] MFA Rules not processed for user `94d0ed0857064f368e9f09b434bf93fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:24:58.938970 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-02895869-b38f-445b-a4fa-fb85a9c9cfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:24:58.952302 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:24:58.998539 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1230/2498] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:24:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:25:01.593201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=53 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:25:08.991830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=16 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:19.459259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020bea0-d476-4bfe-a9c2-b20016d9e9cd None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:19.459777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020bea0-d476-4bfe-a9c2-b20016d9e9cd None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:19.459878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020bea0-d476-4bfe-a9c2-b20016d9e9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:19.497540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1020bea0-d476-4bfe-a9c2-b20016d9e9cd None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:19.498659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1020bea0-d476-4bfe-a9c2-b20016d9e9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:19.578303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1269/2499] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:26:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:19.624782 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02895869-b38f-445b-a4fa-fb85a9c9cfea None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:19.626193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-02895869-b38f-445b-a4fa-fb85a9c9cfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:19.730665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02895869-b38f-445b-a4fa-fb85a9c9cfea None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:19.736169 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964479a9-7b00-414e-a3cd-3076febca09b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:19.736811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964479a9-7b00-414e-a3cd-3076febca09b service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:19.737106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964479a9-7b00-414e-a3cd-3076febca09b service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:19.737368 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964479a9-7b00-414e-a3cd-3076febca09b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:19.745362 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964479a9-7b00-414e-a3cd-3076febca09b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:19.747500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964479a9-7b00-414e-a3cd-3076febca09b service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:19.755522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1231/2500] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:26:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:26:29.576332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=45 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:29.752228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=47 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:33.772779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020bea0-d476-4bfe-a9c2-b20016d9e9cd None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:33.774284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1020bea0-d476-4bfe-a9c2-b20016d9e9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:33.866334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020bea0-d476-4bfe-a9c2-b20016d9e9cd None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:33.871563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54602e29-41cd-452c-8e34-e2f39bead2b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:33.872208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54602e29-41cd-452c-8e34-e2f39bead2b3 service placement] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:33.872492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54602e29-41cd-452c-8e34-e2f39bead2b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:33.872766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54602e29-41cd-452c-8e34-e2f39bead2b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:33.874532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-54602e29-41cd-452c-8e34-e2f39bead2b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:33.885724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54602e29-41cd-452c-8e34-e2f39bead2b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:33.888050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54602e29-41cd-452c-8e34-e2f39bead2b3 service placement] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:33.897860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1270/2501] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:26:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:26:35.784330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf628b-c86d-4af2-acc0-9100a4ed04fc None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:35.784945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf628b-c86d-4af2-acc0-9100a4ed04fc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:35.785370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf628b-c86d-4af2-acc0-9100a4ed04fc None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:35.786822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1232/2502] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:26:35.794924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44944e-ee30-44d8-ad8e-1885c015734d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:35.795484 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44944e-ee30-44d8-ad8e-1885c015734d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:35.795602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c44944e-ee30-44d8-ad8e-1885c015734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:35.837888 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-5c44944e-ee30-44d8-ad8e-1885c015734d None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:35.839353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-5c44944e-ee30-44d8-ad8e-1885c015734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:35.859776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1271/2503] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:26:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:35.871751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf628b-c86d-4af2-acc0-9100a4ed04fc None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:35.873497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c6bf628b-c86d-4af2-acc0-9100a4ed04fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:35.932675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf628b-c86d-4af2-acc0-9100a4ed04fc None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:35.937123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c7c11-c546-4e04-9dbd-330e4239cc21 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210e10ee6b649399de11ac719a89718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:35.937759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c7c11-c546-4e04-9dbd-330e4239cc21 service glance] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:35.938038 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c7c11-c546-4e04-9dbd-330e4239cc21 service glance] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:35.938310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c7c11-c546-4e04-9dbd-330e4239cc21 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:35.948192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c7c11-c546-4e04-9dbd-330e4239cc21 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:35.949875 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c7c11-c546-4e04-9dbd-330e4239cc21 service glance] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:35.960539 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1233/2504] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:26:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:26:36.047683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6487-9fcc-4aac-8b05-dcb182b00d99 None None] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:36.048016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6487-9fcc-4aac-8b05-dcb182b00d99 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:36.048300 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c6487-9fcc-4aac-8b05-dcb182b00d99 None None] PATH_INFO: `/` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:36.049793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1272/2505] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:26:36.056123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575e120-4944-4658-81c1-07ae2e5fe56e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:36.056621 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575e120-4944-4658-81c1-07ae2e5fe56e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:36.057076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1575e120-4944-4658-81c1-07ae2e5fe56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:36.089715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-1575e120-4944-4658-81c1-07ae2e5fe56e None None] MFA Rules not processed for user `b3b2d5dee6d240558a71331e05035a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:36.090983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-1575e120-4944-4658-81c1-07ae2e5fe56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:36.111858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1234/2506] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:26:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:26:36.126794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c6487-9fcc-4aac-8b05-dcb182b00d99 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:36.128650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-bd1c6487-9fcc-4aac-8b05-dcb182b00d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:36.143649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c6487-9fcc-4aac-8b05-dcb182b00d99 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:36.147592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa5c9fc-3868-4ac1-8b32-8335d644b7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:36.148308 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5c9fc-3868-4ac1-8b32-8335d644b7ec service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:36.148594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5c9fc-3868-4ac1-8b32-8335d644b7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:36.148868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa5c9fc-3868-4ac1-8b32-8335d644b7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:36.156910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5c9fc-3868-4ac1-8b32-8335d644b7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:36.158395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa5c9fc-3868-4ac1-8b32-8335d644b7ec service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:36.166547 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1273/2507] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:26:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:26:36.253438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd4a30-aa71-4b36-9288-43f13e515d46 None None] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:36.253730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd4a30-aa71-4b36-9288-43f13e515d46 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:36.254011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd4a30-aa71-4b36-9288-43f13e515d46 None None] PATH_INFO: `/` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:36.255459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1235/2508] 10.222.0.48 () {54 vars in 921 bytes} [Thu Jul 21 04:26:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 21 04:26:36.260200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95b7c9-1666-4086-8944-6c6380df216d None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:36.260492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95b7c9-1666-4086-8944-6c6380df216d None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:36.260774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b95b7c9-1666-4086-8944-6c6380df216d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:36.279411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-5b95b7c9-1666-4086-8944-6c6380df216d None None] MFA Rules not processed for user `5a82fed4ff8845919b1da05f7e8d1d72`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:36.280609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-5b95b7c9-1666-4086-8944-6c6380df216d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:36.290035 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1274/2509] 10.222.0.48 () {58 vars in 1018 bytes} [Thu Jul 21 04:26:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:36.301870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd4a30-aa71-4b36-9288-43f13e515d46 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:36.313181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accd4a30-aa71-4b36-9288-43f13e515d46 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:36.316786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1399b4-40e4-4ec8-b493-2f6d65f95eee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:36.317418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1399b4-40e4-4ec8-b493-2f6d65f95eee service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:36.317705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1399b4-40e4-4ec8-b493-2f6d65f95eee service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:36.317983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1399b4-40e4-4ec8-b493-2f6d65f95eee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:36.328297 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1399b4-40e4-4ec8-b493-2f6d65f95eee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:36.329738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1399b4-40e4-4ec8-b493-2f6d65f95eee service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:36.341082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1236/2510] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:26:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:26:38.886829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7304-4d05-4de6-a93e-60e8c76d2194 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:38.887368 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7304-4d05-4de6-a93e-60e8c76d2194 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:38.887480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e7304-4d05-4de6-a93e-60e8c76d2194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:38.906748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-6d1e7304-4d05-4de6-a93e-60e8c76d2194 None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:38.908051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6d1e7304-4d05-4de6-a93e-60e8c76d2194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:38.916141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1275/2511] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:26:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:26:38.928826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1399b4-40e4-4ec8-b493-2f6d65f95eee service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:38.940834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1399b4-40e4-4ec8-b493-2f6d65f95eee service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:38.945935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45587-5623-4cfb-b22c-aa0077bca152 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:38.946730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45587-5623-4cfb-b22c-aa0077bca152 service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:38.947123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45587-5623-4cfb-b22c-aa0077bca152 service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:38.947568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f45587-5623-4cfb-b22c-aa0077bca152 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:38.957004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f45587-5623-4cfb-b22c-aa0077bca152 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:38.958808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f45587-5623-4cfb-b22c-aa0077bca152 service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:38.967915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1237/2512] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:26:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:26:44.268596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e7304-4d05-4de6-a93e-60e8c76d2194 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:44.280212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e7304-4d05-4de6-a93e-60e8c76d2194 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:44.284175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0794f6-142d-44c8-af26-1533d5790dd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:44.285067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0794f6-142d-44c8-af26-1533d5790dd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:44.285352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0794f6-142d-44c8-af26-1533d5790dd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:44.285626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0794f6-142d-44c8-af26-1533d5790dd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:44.287465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-bb0794f6-142d-44c8-af26-1533d5790dd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:44.324522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0794f6-142d-44c8-af26-1533d5790dd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:44.325996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0794f6-142d-44c8-af26-1533d5790dd3 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:44.345977 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1276/2513] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:26:48.151292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45587-5623-4cfb-b22c-aa0077bca152 service swift] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:48.152775 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-34f45587-5623-4cfb-b22c-aa0077bca152 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:48.166832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f45587-5623-4cfb-b22c-aa0077bca152 service swift] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:48.171874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:48.172742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:48.173024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:48.173299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] PATH_INFO: `/v3/users/94d0ed0857064f368e9f09b434bf93fa` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:48.174471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94d0ed0857064f368e9f09b434bf93fa)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:48.176458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:48.227684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94d0ed0857064f368e9f09b434bf93fa'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:48.228336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94d0ed0857064f368e9f09b434bf93fa'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:48.229273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94d0ed0857064f368e9f09b434bf93fa'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:48.236667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94d0ed0857064f368e9f09b434bf93fa'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:48.244036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c544a349-4911-43ad-8bb3-2f4a1d2f53d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94d0ed0857064f368e9f09b434bf93fa'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:48.261858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1238/2514] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:26:48 2022] DELETE /identity/v3/users/94d0ed0857064f368e9f09b434bf93fa => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:26:48.520794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0794f6-142d-44c8-af26-1533d5790dd3 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:48.534820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0794f6-142d-44c8-af26-1533d5790dd3 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:48.561972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:48.596255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:48.597103 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:48.597619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:48.597765 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] PATH_INFO: `/v3/projects/801e3cfb6ca74f2b94946e52d60b5854` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:48.598874 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=801e3cfb6ca74f2b94946e52d60b5854)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:48.600880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:48.649514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '801e3cfb6ca74f2b94946e52d60b5854', 'request_id': 'req-6671a3f0-8724-4e37-8c77-3074c8cc84d5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:48.658155 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '801e3cfb6ca74f2b94946e52d60b5854', 'request_id': 'req-6671a3f0-8724-4e37-8c77-3074c8cc84d5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:48.664038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '801e3cfb6ca74f2b94946e52d60b5854', 'request_id': 'req-6671a3f0-8724-4e37-8c77-3074c8cc84d5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:48.675042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] The token cache is being invalidate because project 801e3cfb6ca74f2b94946e52d60b5854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:26:48.675331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:48.675959 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-6671a3f0-8724-4e37-8c77-3074c8cc84d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:48.677521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1277/2515] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:26:48 2022] DELETE /identity/v3/projects/801e3cfb6ca74f2b94946e52d60b5854 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:26:48.682441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9e2c7-5e56-4558-9554-2068a85378dc None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:48.682722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9e2c7-5e56-4558-9554-2068a85378dc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:48.683041 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9e2c7-5e56-4558-9554-2068a85378dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:48.715517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:48.730502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-06a9e2c7-5e56-4558-9554-2068a85378dc None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:48.731786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-06a9e2c7-5e56-4558-9554-2068a85378dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:48.790772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1239/2516] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:48.799078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4e87-94b9-424c-879c-9f1fe0985424 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:48.799371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4e87-94b9-424c-879c-9f1fe0985424 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:48.799649 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc4e87-94b9-424c-879c-9f1fe0985424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:48.818366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-bacc4e87-94b9-424c-879c-9f1fe0985424 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:48.819612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-bacc4e87-94b9-424c-879c-9f1fe0985424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:48.828162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1278/2517] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:48.832429 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9e2c7-5e56-4558-9554-2068a85378dc None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:48.842060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9e2c7-5e56-4558-9554-2068a85378dc None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:48.847194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e264-1e03-4a3e-bac6-b3bfc03021e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:48.847852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e264-1e03-4a3e-bac6-b3bfc03021e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:48.848138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e264-1e03-4a3e-bac6-b3bfc03021e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:48.848417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d1e264-1e03-4a3e-bac6-b3bfc03021e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:48.849145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e264-1e03-4a3e-bac6-b3bfc03021e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:26:48.849457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e264-1e03-4a3e-bac6-b3bfc03021e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:48.851114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d1e264-1e03-4a3e-bac6-b3bfc03021e0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:48.863414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1240/2518] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:26:48.867713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4e87-94b9-424c-879c-9f1fe0985424 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:48.877724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc4e87-94b9-424c-879c-9f1fe0985424 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:48.882678 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe428e0c-9bbe-4e92-9f49-68b54866a9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:48.883425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428e0c-9bbe-4e92-9f49-68b54866a9e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:48.883712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428e0c-9bbe-4e92-9f49-68b54866a9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:48.883983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe428e0c-9bbe-4e92-9f49-68b54866a9e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:48.884666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe428e0c-9bbe-4e92-9f49-68b54866a9e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:48.886733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe428e0c-9bbe-4e92-9f49-68b54866a9e5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:48.912370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1279/2519] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:26:48 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:26:48.917612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e264-1e03-4a3e-bac6-b3bfc03021e0 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:48.927668 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d1e264-1e03-4a3e-bac6-b3bfc03021e0 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:48.984072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41767ea-333d-4297-af41-e1ea512e5065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:48.984796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41767ea-333d-4297-af41-e1ea512e5065 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:48.985083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41767ea-333d-4297-af41-e1ea512e5065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:48.985360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41767ea-333d-4297-af41-e1ea512e5065 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:48.986052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41767ea-333d-4297-af41-e1ea512e5065 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:48.988008 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41767ea-333d-4297-af41-e1ea512e5065 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:49.007254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1241/2520] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:26:48 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:26:49.011559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe428e0c-9bbe-4e92-9f49-68b54866a9e5 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:49.021783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe428e0c-9bbe-4e92-9f49-68b54866a9e5 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:49.027179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62169286-c67f-49fa-8136-ddebaf7c2884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:49.027869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62169286-c67f-49fa-8136-ddebaf7c2884 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:49.028157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62169286-c67f-49fa-8136-ddebaf7c2884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:49.028441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62169286-c67f-49fa-8136-ddebaf7c2884 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:49.029170 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62169286-c67f-49fa-8136-ddebaf7c2884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:49.030878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62169286-c67f-49fa-8136-ddebaf7c2884 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:49.044355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1280/2521] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:26:49.048392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41767ea-333d-4297-af41-e1ea512e5065 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:49.058319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41767ea-333d-4297-af41-e1ea512e5065 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:49.062919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8da1a25-e1d3-4c7b-bd98-2e38b7c4185c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:49.063604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1a25-e1d3-4c7b-bd98-2e38b7c4185c admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:49.063898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1a25-e1d3-4c7b-bd98-2e38b7c4185c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:49.064167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8da1a25-e1d3-4c7b-bd98-2e38b7c4185c admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:49.064889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da1a25-e1d3-4c7b-bd98-2e38b7c4185c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:49.066497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8da1a25-e1d3-4c7b-bd98-2e38b7c4185c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:49.076515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1242/2522] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:26:49.080480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62169286-c67f-49fa-8136-ddebaf7c2884 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:49.090785 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62169286-c67f-49fa-8136-ddebaf7c2884 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:49.095378 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b77fe-5d11-4743-8af0-932b454ec96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:49.096243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b77fe-5d11-4743-8af0-932b454ec96f admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:49.096523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b77fe-5d11-4743-8af0-932b454ec96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:49.096798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b77fe-5d11-4743-8af0-932b454ec96f admin admin] PATH_INFO: `/v3/projects/fad6a59b76b54b9e96d41936138e5cb2/users/af4f0196c7f447219730bb69442a8001/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:49.111798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b77fe-5d11-4743-8af0-932b454ec96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad6a59b76b54b9e96d41936138e5cb2, user_id=af4f0196c7f447219730bb69442a8001, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:49.114447 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052b77fe-5d11-4743-8af0-932b454ec96f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:49.128301 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1281/2523] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:26:49 2022] PUT /identity/v3/projects/fad6a59b76b54b9e96d41936138e5cb2/users/af4f0196c7f447219730bb69442a8001/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:26:49.139874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88dfb0-e2aa-4091-9db1-84876476d246 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:49.140168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88dfb0-e2aa-4091-9db1-84876476d246 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:49.140446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc88dfb0-e2aa-4091-9db1-84876476d246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:49.166150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-cc88dfb0-e2aa-4091-9db1-84876476d246 None None] MFA Rules not processed for user `af4f0196c7f447219730bb69442a8001`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:49.167359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-cc88dfb0-e2aa-4091-9db1-84876476d246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:49.224021 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:49.234212 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1243/2524] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:26:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:49.245597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b77fe-5d11-4743-8af0-932b454ec96f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:49.247335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-052b77fe-5d11-4743-8af0-932b454ec96f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:49.305365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:49.327867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052b77fe-5d11-4743-8af0-932b454ec96f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:49.331497 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408186-fd80-40b9-9468-3a430a7b7c33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:49.332197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408186-fd80-40b9-9468-3a430a7b7c33 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:49.332481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408186-fd80-40b9-9468-3a430a7b7c33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:49.332757 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26408186-fd80-40b9-9468-3a430a7b7c33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:49.340916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26408186-fd80-40b9-9468-3a430a7b7c33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:49.342342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26408186-fd80-40b9-9468-3a430a7b7c33 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:49.350893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1282/2525] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:26:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:26:55.967523 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9e499-e579-4537-b8b8-671ccbf3f46e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:55.968012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9e499-e579-4537-b8b8-671ccbf3f46e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:55.968120 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db9e499-e579-4537-b8b8-671ccbf3f46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:55.987776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7db9e499-e579-4537-b8b8-671ccbf3f46e None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:55.988961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7db9e499-e579-4537-b8b8-671ccbf3f46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:56.043896 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1244/2526] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 21 04:26:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:56.056640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408186-fd80-40b9-9468-3a430a7b7c33 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:56.058754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-26408186-fd80-40b9-9468-3a430a7b7c33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:56.126822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26408186-fd80-40b9-9468-3a430a7b7c33 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:56.131756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b387ef8-4bf0-4e1b-b84b-178344ca9c86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:56.132400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387ef8-4bf0-4e1b-b84b-178344ca9c86 service swift] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:56.132691 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387ef8-4bf0-4e1b-b84b-178344ca9c86 service swift] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:56.132967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b387ef8-4bf0-4e1b-b84b-178344ca9c86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:56.141211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387ef8-4bf0-4e1b-b84b-178344ca9c86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:56.142801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b387ef8-4bf0-4e1b-b84b-178344ca9c86 service swift] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:56.150811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1283/2527] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:26:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:26:57.761107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9e499-e579-4537-b8b8-671ccbf3f46e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:57.823511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db9e499-e579-4537-b8b8-671ccbf3f46e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:57.828081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:57.828947 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:57.829231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:57.829506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] PATH_INFO: `/v3/users/af4f0196c7f447219730bb69442a8001` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:57.830703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af4f0196c7f447219730bb69442a8001)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:57.832675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:57.878449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af4f0196c7f447219730bb69442a8001'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:57.879135 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af4f0196c7f447219730bb69442a8001'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:57.879750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af4f0196c7f447219730bb69442a8001'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:57.886744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af4f0196c7f447219730bb69442a8001'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:57.893783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af4f0196c7f447219730bb69442a8001'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:57.911813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1245/2528] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:26:57 2022] DELETE /identity/v3/users/af4f0196c7f447219730bb69442a8001 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:26:57.917291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d499aa-8779-4ac1-a1f4-f552a472cd0c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:57.917796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d499aa-8779-4ac1-a1f4-f552a472cd0c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:57.917983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d499aa-8779-4ac1-a1f4-f552a472cd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:57.934515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b6d499aa-8779-4ac1-a1f4-f552a472cd0c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:57.935741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b6d499aa-8779-4ac1-a1f4-f552a472cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:57.995868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1284/2529] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:58.005412 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:58.006797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:58.029073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:58.066747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6744c71-231b-4515-8ad0-b69799a66d64 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:58.070396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f3ffe-cedf-4a5e-b9d6-6a9474c6394c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:58.071063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f3ffe-cedf-4a5e-b9d6-6a9474c6394c service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.071349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f3ffe-cedf-4a5e-b9d6-6a9474c6394c service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.071626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f3ffe-cedf-4a5e-b9d6-6a9474c6394c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.080833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f3ffe-cedf-4a5e-b9d6-6a9474c6394c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:58.082185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f3ffe-cedf-4a5e-b9d6-6a9474c6394c service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:58.092879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1246/2530] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:26:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:26:58.360731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d499aa-8779-4ac1-a1f4-f552a472cd0c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:58.362152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b6d499aa-8779-4ac1-a1f4-f552a472cd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:58.376650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d499aa-8779-4ac1-a1f4-f552a472cd0c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:58.382553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:58.383346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.383667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.383880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] PATH_INFO: `/v3/projects/fad6a59b76b54b9e96d41936138e5cb2` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.385555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad6a59b76b54b9e96d41936138e5cb2)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:58.387509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:58.434764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad6a59b76b54b9e96d41936138e5cb2', 'request_id': 'req-d1918178-739d-4f9b-b6c1-26198105f302'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:58.441663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad6a59b76b54b9e96d41936138e5cb2', 'request_id': 'req-d1918178-739d-4f9b-b6c1-26198105f302'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:58.445549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:58.448354 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad6a59b76b54b9e96d41936138e5cb2', 'request_id': 'req-d1918178-739d-4f9b-b6c1-26198105f302'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:58.460970 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] The token cache is being invalidate because project fad6a59b76b54b9e96d41936138e5cb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:26:58.461262 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:58.461924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d1918178-739d-4f9b-b6c1-26198105f302 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:26:58.464125 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1285/2531] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:26:58 2022] DELETE /identity/v3/projects/fad6a59b76b54b9e96d41936138e5cb2 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:26:58.469732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8f86a-6931-4a85-8406-cb4e9264b82b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.470024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8f86a-6931-4a85-8406-cb4e9264b82b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.470303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8f86a-6931-4a85-8406-cb4e9264b82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.488989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-ced8f86a-6931-4a85-8406-cb4e9264b82b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:58.490190 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ced8f86a-6931-4a85-8406-cb4e9264b82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:58.549667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1247/2532] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:58.558263 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843161-2625-4e15-8e34-f557e5d1cd0e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.558544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843161-2625-4e15-8e34-f557e5d1cd0e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.558817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843161-2625-4e15-8e34-f557e5d1cd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.576704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-59843161-2625-4e15-8e34-f557e5d1cd0e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:58.577894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-59843161-2625-4e15-8e34-f557e5d1cd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:58.585646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1286/2533] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:58.589801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8f86a-6931-4a85-8406-cb4e9264b82b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:58.599492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8f86a-6931-4a85-8406-cb4e9264b82b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:58.604626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3814-7dd2-4f55-87d0-fd2100e7e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:58.605214 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3814-7dd2-4f55-87d0-fd2100e7e941 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.605496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3814-7dd2-4f55-87d0-fd2100e7e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.605774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e3814-7dd2-4f55-87d0-fd2100e7e941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.606493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3814-7dd2-4f55-87d0-fd2100e7e941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:26:58.606801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3814-7dd2-4f55-87d0-fd2100e7e941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:58.608456 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e3814-7dd2-4f55-87d0-fd2100e7e941 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:58.620461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1248/2534] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:26:58.624549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843161-2625-4e15-8e34-f557e5d1cd0e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:58.633659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843161-2625-4e15-8e34-f557e5d1cd0e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:58.638271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20702172-e960-4989-9990-af6958010776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:58.638908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20702172-e960-4989-9990-af6958010776 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.639224 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20702172-e960-4989-9990-af6958010776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.639499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20702172-e960-4989-9990-af6958010776 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.640202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20702172-e960-4989-9990-af6958010776 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:58.642111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20702172-e960-4989-9990-af6958010776 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:58.668052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1287/2535] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:26:58 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:26:58.672104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3814-7dd2-4f55-87d0-fd2100e7e941 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:58.682126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e3814-7dd2-4f55-87d0-fd2100e7e941 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:58.740707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954c835-1619-4055-8d7c-2b473390fdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:58.741371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954c835-1619-4055-8d7c-2b473390fdfb admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.741657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954c835-1619-4055-8d7c-2b473390fdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.741974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4954c835-1619-4055-8d7c-2b473390fdfb admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.742690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954c835-1619-4055-8d7c-2b473390fdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:58.744880 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4954c835-1619-4055-8d7c-2b473390fdfb admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:58.764540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1249/2536] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:26:58 2022] POST /identity/v3/users => generated 284 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:26:58.768608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20702172-e960-4989-9990-af6958010776 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:58.779611 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20702172-e960-4989-9990-af6958010776 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:58.784482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de44e5-93c3-4ae9-90d4-befb5f60c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:58.785137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de44e5-93c3-4ae9-90d4-befb5f60c44a admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.785425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de44e5-93c3-4ae9-90d4-befb5f60c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.785706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de44e5-93c3-4ae9-90d4-befb5f60c44a admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.786461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de44e5-93c3-4ae9-90d4-befb5f60c44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:58.788113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de44e5-93c3-4ae9-90d4-befb5f60c44a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:58.799332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1288/2537] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:26:58.803189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954c835-1619-4055-8d7c-2b473390fdfb admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:58.813470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4954c835-1619-4055-8d7c-2b473390fdfb admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:58.818035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fb1a0-deb2-4f8a-a232-5ab16a8ce33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:58.818681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb1a0-deb2-4f8a-a232-5ab16a8ce33e admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.818984 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb1a0-deb2-4f8a-a232-5ab16a8ce33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.819262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fb1a0-deb2-4f8a-a232-5ab16a8ce33e admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.819975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fb1a0-deb2-4f8a-a232-5ab16a8ce33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:58.821568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fb1a0-deb2-4f8a-a232-5ab16a8ce33e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:58.831815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1250/2538] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:26:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:26:58.835819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de44e5-93c3-4ae9-90d4-befb5f60c44a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:58.846227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de44e5-93c3-4ae9-90d4-befb5f60c44a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:58.850766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823038-793c-4a75-95ed-a538c659a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:58.851663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823038-793c-4a75-95ed-a538c659a848 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.851940 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823038-793c-4a75-95ed-a538c659a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.852215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823038-793c-4a75-95ed-a538c659a848 admin admin] PATH_INFO: `/v3/projects/819d59a56c464da8ab738f8a80b1b252/users/9bacfe304d724a4ab803e08b6202f7ce/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.866803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823038-793c-4a75-95ed-a538c659a848 admin admin] RBAC: Authorizing `identity:create_grant(project_id=819d59a56c464da8ab738f8a80b1b252, user_id=9bacfe304d724a4ab803e08b6202f7ce, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:58.869637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823038-793c-4a75-95ed-a538c659a848 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:58.882367 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1289/2539] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:26:58 2022] PUT /identity/v3/projects/819d59a56c464da8ab738f8a80b1b252/users/9bacfe304d724a4ab803e08b6202f7ce/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:26:58.893218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0c5ce-899b-440c-bcaa-d658df1f5e01 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:58.893536 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0c5ce-899b-440c-bcaa-d658df1f5e01 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:58.893817 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec0c5ce-899b-440c-bcaa-d658df1f5e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:58.921417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-aec0c5ce-899b-440c-bcaa-d658df1f5e01 None None] MFA Rules not processed for user `9bacfe304d724a4ab803e08b6202f7ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:58.922643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-aec0c5ce-899b-440c-bcaa-d658df1f5e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:58.938969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:58.987647 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1251/2540] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:26:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:58.992212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823038-793c-4a75-95ed-a538c659a848 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:59.053229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823038-793c-4a75-95ed-a538c659a848 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:59.058294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dfef5-2d82-4046-b0ff-01162b94a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:59.058973 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dfef5-2d82-4046-b0ff-01162b94a852 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:59.059256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dfef5-2d82-4046-b0ff-01162b94a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:59.059533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14dfef5-2d82-4046-b0ff-01162b94a852 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:59.060225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dfef5-2d82-4046-b0ff-01162b94a852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:59.062166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14dfef5-2d82-4046-b0ff-01162b94a852 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:59.092523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1290/2541] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:26:58 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:26:59.096691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0c5ce-899b-440c-bcaa-d658df1f5e01 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:59.107678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec0c5ce-899b-440c-bcaa-d658df1f5e01 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:59.163914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa4afe-2dc8-4aa3-9cac-761db3f7a89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:59.164510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa4afe-2dc8-4aa3-9cac-761db3f7a89e admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:59.164796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa4afe-2dc8-4aa3-9cac-761db3f7a89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:59.165074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa4afe-2dc8-4aa3-9cac-761db3f7a89e admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:59.165757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa4afe-2dc8-4aa3-9cac-761db3f7a89e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:59.168163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97aa4afe-2dc8-4aa3-9cac-761db3f7a89e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:59.188158 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1252/2542] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:26:59 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:26:59.192257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dfef5-2d82-4046-b0ff-01162b94a852 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:59.203183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14dfef5-2d82-4046-b0ff-01162b94a852 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:59.207856 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49e57e-57dd-40cd-b222-08d16cd368ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:59.208519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49e57e-57dd-40cd-b222-08d16cd368ee admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:59.208808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49e57e-57dd-40cd-b222-08d16cd368ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:59.209086 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e49e57e-57dd-40cd-b222-08d16cd368ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:59.209813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49e57e-57dd-40cd-b222-08d16cd368ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:59.211475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e49e57e-57dd-40cd-b222-08d16cd368ee admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:59.222985 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1291/2543] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:26:59.226901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa4afe-2dc8-4aa3-9cac-761db3f7a89e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:59.236745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa4afe-2dc8-4aa3-9cac-761db3f7a89e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:59.241376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2e4ec-a739-43fc-aa33-5572527ca777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:59.242254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2e4ec-a739-43fc-aa33-5572527ca777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:59.242541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2e4ec-a739-43fc-aa33-5572527ca777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:59.242820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a2e4ec-a739-43fc-aa33-5572527ca777 admin admin] PATH_INFO: `/v3/projects/b437696e5c534f578451f733cedfdab0/users/79c2408912c34e958e8dac2636e1dd71/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:59.257404 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2e4ec-a739-43fc-aa33-5572527ca777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b437696e5c534f578451f733cedfdab0, user_id=79c2408912c34e958e8dac2636e1dd71, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:59.260732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a2e4ec-a739-43fc-aa33-5572527ca777 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:59.272994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1253/2544] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:26:59 2022] PUT /identity/v3/projects/b437696e5c534f578451f733cedfdab0/users/79c2408912c34e958e8dac2636e1dd71/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:26:59.277758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49e57e-57dd-40cd-b222-08d16cd368ee admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:59.288247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e49e57e-57dd-40cd-b222-08d16cd368ee admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:59.344587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12df4233-f949-45be-8870-d53afdd93b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:59.345247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df4233-f949-45be-8870-d53afdd93b0c admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:59.345530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df4233-f949-45be-8870-d53afdd93b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:59.345811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12df4233-f949-45be-8870-d53afdd93b0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:59.346531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df4233-f949-45be-8870-d53afdd93b0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:59.348188 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12df4233-f949-45be-8870-d53afdd93b0c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:59.349402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:26:59.362169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1292/2545] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:26:59.363489 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2e4ec-a739-43fc-aa33-5572527ca777 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:59.375477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a2e4ec-a739-43fc-aa33-5572527ca777 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:59.380301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2ccf1-d7cf-44cd-87b4-2eb55f234243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:59.381188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2ccf1-d7cf-44cd-87b4-2eb55f234243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:59.381478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2ccf1-d7cf-44cd-87b4-2eb55f234243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:59.381758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e2ccf1-d7cf-44cd-87b4-2eb55f234243 admin admin] PATH_INFO: `/v3/projects/b437696e5c534f578451f733cedfdab0/users/79c2408912c34e958e8dac2636e1dd71/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:59.383945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2ccf1-d7cf-44cd-87b4-2eb55f234243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b437696e5c534f578451f733cedfdab0, user_id=79c2408912c34e958e8dac2636e1dd71, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:59.387546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e2ccf1-d7cf-44cd-87b4-2eb55f234243 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:59.401365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1254/2546] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:26:59 2022] PUT /identity/v3/projects/b437696e5c534f578451f733cedfdab0/users/79c2408912c34e958e8dac2636e1dd71/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:26:59.412904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb637d9-982a-4e02-ad53-832e4fe56c2e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:59.413196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb637d9-982a-4e02-ad53-832e4fe56c2e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:59.413481 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb637d9-982a-4e02-ad53-832e4fe56c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:59.440739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ecb637d9-982a-4e02-ad53-832e4fe56c2e None None] MFA Rules not processed for user `79c2408912c34e958e8dac2636e1dd71`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:26:59.441972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ecb637d9-982a-4e02-ad53-832e4fe56c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:59.507596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1293/2547] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:26:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:26:59.518595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2ccf1-d7cf-44cd-87b4-2eb55f234243 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:26:59.520373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-33e2ccf1-d7cf-44cd-87b4-2eb55f234243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:26:59.579515 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e2ccf1-d7cf-44cd-87b4-2eb55f234243 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:26:59.583184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5449619a-24a0-4704-9c09-b6afc1a0a6ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:26:59.583826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449619a-24a0-4704-9c09-b6afc1a0a6ba service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:26:59.584113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449619a-24a0-4704-9c09-b6afc1a0a6ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:26:59.584416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5449619a-24a0-4704-9c09-b6afc1a0a6ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:26:59.593419 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449619a-24a0-4704-9c09-b6afc1a0a6ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:26:59.594865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5449619a-24a0-4704-9c09-b6afc1a0a6ba service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:26:59.604537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1255/2548] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:26:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:00.932171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb637d9-982a-4e02-ad53-832e4fe56c2e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:01.009474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb637d9-982a-4e02-ad53-832e4fe56c2e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:01.014491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:01.015946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:01.016240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:01.016517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] PATH_INFO: `/v3/users/9bacfe304d724a4ab803e08b6202f7ce` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:01.017738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bacfe304d724a4ab803e08b6202f7ce)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:01.019774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:01.074871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bacfe304d724a4ab803e08b6202f7ce'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.075623 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bacfe304d724a4ab803e08b6202f7ce'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.076242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bacfe304d724a4ab803e08b6202f7ce'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.086486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bacfe304d724a4ab803e08b6202f7ce'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.095979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bacfe304d724a4ab803e08b6202f7ce'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.113807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:01.120429 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1294/2549] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:00 2022] DELETE /identity/v3/users/9bacfe304d724a4ab803e08b6202f7ce => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:01.125019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6438-2172-4cd2-aea5-f964028db9ab None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:01.125631 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6438-2172-4cd2-aea5-f964028db9ab None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:01.125819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174c6438-2172-4cd2-aea5-f964028db9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:01.147541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-174c6438-2172-4cd2-aea5-f964028db9ab None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:01.148747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-174c6438-2172-4cd2-aea5-f964028db9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:01.157942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:01.221474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1256/2550] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:01.232206 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:01.233773 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:01.296622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f45f7-19df-40f9-ada6-381dbbca8fef admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:01.300173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca35b02-c91d-4fff-9d24-c0ba46554a7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:01.301258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca35b02-c91d-4fff-9d24-c0ba46554a7b service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:01.301659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca35b02-c91d-4fff-9d24-c0ba46554a7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:01.301934 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca35b02-c91d-4fff-9d24-c0ba46554a7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:01.312972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca35b02-c91d-4fff-9d24-c0ba46554a7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:01.315150 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca35b02-c91d-4fff-9d24-c0ba46554a7b service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:01.327693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1295/2551] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:01.611162 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c6438-2172-4cd2-aea5-f964028db9ab None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:01.612855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-174c6438-2172-4cd2-aea5-f964028db9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:01.626128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174c6438-2172-4cd2-aea5-f964028db9ab None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:01.630892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:01.632224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:01.632224 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:01.632440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] PATH_INFO: `/v3/projects/819d59a56c464da8ab738f8a80b1b252` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:01.633517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=819d59a56c464da8ab738f8a80b1b252)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:01.636894 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:01.685059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819d59a56c464da8ab738f8a80b1b252', 'request_id': 'req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.692486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819d59a56c464da8ab738f8a80b1b252', 'request_id': 'req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.698861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819d59a56c464da8ab738f8a80b1b252', 'request_id': 'req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.709932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] The token cache is being invalidate because project 819d59a56c464da8ab738f8a80b1b252 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:01.710218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.710866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.712433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1257/2552] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:01 2022] DELETE /identity/v3/projects/819d59a56c464da8ab738f8a80b1b252 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:01.716821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca35b02-c91d-4fff-9d24-c0ba46554a7b service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:01.726385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca35b02-c91d-4fff-9d24-c0ba46554a7b service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:01.795628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:01.796493 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:01.796770 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:01.797042 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] PATH_INFO: `/v3/users/79c2408912c34e958e8dac2636e1dd71` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:01.798209 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=79c2408912c34e958e8dac2636e1dd71)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:01.800168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:01.845617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79c2408912c34e958e8dac2636e1dd71'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.846196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79c2408912c34e958e8dac2636e1dd71'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.846799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79c2408912c34e958e8dac2636e1dd71'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.853877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79c2408912c34e958e8dac2636e1dd71'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.860961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-5150ca34-109f-4f9b-a190-d8e5d3e35b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79c2408912c34e958e8dac2636e1dd71'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:01.880437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1296/2553] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:01 2022] DELETE /identity/v3/users/79c2408912c34e958e8dac2636e1dd71 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:02.154616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:02.156144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:02.172994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6ba2e-b713-4359-87e7-c74a9e3efc26 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:02.230808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:02.231704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.231985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.232259 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] PATH_INFO: `/v3/projects/b437696e5c534f578451f733cedfdab0` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.233443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b437696e5c534f578451f733cedfdab0)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:02.235391 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:02.274843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:02.283744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b437696e5c534f578451f733cedfdab0', 'request_id': 'req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:02.290590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b437696e5c534f578451f733cedfdab0', 'request_id': 'req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:02.296783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b437696e5c534f578451f733cedfdab0', 'request_id': 'req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:02.308174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] The token cache is being invalidate because project b437696e5c534f578451f733cedfdab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:02.308459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:02.309097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-43bbc92c-f6d8-41e4-a6ee-9e57af4279a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:02.310622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1258/2554] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:02 2022] DELETE /identity/v3/projects/b437696e5c534f578451f733cedfdab0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:02.315896 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69651f-dbbf-4ee9-b2d4-2f9be08d4569 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.316357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69651f-dbbf-4ee9-b2d4-2f9be08d4569 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.316452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69651f-dbbf-4ee9-b2d4-2f9be08d4569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.334298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-bf69651f-dbbf-4ee9-b2d4-2f9be08d4569 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:02.335662 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-bf69651f-dbbf-4ee9-b2d4-2f9be08d4569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:02.353026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:02.396641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1297/2555] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:02.404745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92469b62-3513-4aba-b42f-df684f805ad6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.405057 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92469b62-3513-4aba-b42f-df684f805ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.405361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92469b62-3513-4aba-b42f-df684f805ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.424115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-92469b62-3513-4aba-b42f-df684f805ad6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:02.425301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-92469b62-3513-4aba-b42f-df684f805ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:02.433217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1259/2556] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:02.437293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69651f-dbbf-4ee9-b2d4-2f9be08d4569 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:02.447089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69651f-dbbf-4ee9-b2d4-2f9be08d4569 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:02.451723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339269ef-b70b-47db-89e2-72f4887695bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:02.452373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339269ef-b70b-47db-89e2-72f4887695bd admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.452665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339269ef-b70b-47db-89e2-72f4887695bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.452941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339269ef-b70b-47db-89e2-72f4887695bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.453670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339269ef-b70b-47db-89e2-72f4887695bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:27:02.454004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339269ef-b70b-47db-89e2-72f4887695bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:02.455670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339269ef-b70b-47db-89e2-72f4887695bd admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:02.467797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1298/2557] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:27:02.471820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92469b62-3513-4aba-b42f-df684f805ad6 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:02.481644 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92469b62-3513-4aba-b42f-df684f805ad6 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:02.486316 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85330c-1f59-4695-ba7a-7d39bed2d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:02.486979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85330c-1f59-4695-ba7a-7d39bed2d62f admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.487257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85330c-1f59-4695-ba7a-7d39bed2d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.487527 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f85330c-1f59-4695-ba7a-7d39bed2d62f admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.488215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85330c-1f59-4695-ba7a-7d39bed2d62f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:02.490106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f85330c-1f59-4695-ba7a-7d39bed2d62f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:02.515972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1260/2558] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:27:02 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:02.519979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339269ef-b70b-47db-89e2-72f4887695bd admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:02.530821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339269ef-b70b-47db-89e2-72f4887695bd admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:02.587396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abb76e-5a8d-42fb-84a5-382f85440435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:02.588986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abb76e-5a8d-42fb-84a5-382f85440435 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.589285 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abb76e-5a8d-42fb-84a5-382f85440435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.589591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68abb76e-5a8d-42fb-84a5-382f85440435 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.590289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abb76e-5a8d-42fb-84a5-382f85440435 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:02.592259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68abb76e-5a8d-42fb-84a5-382f85440435 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:02.612979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1299/2559] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:27:02 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:27:02.617053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85330c-1f59-4695-ba7a-7d39bed2d62f admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:02.627829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f85330c-1f59-4695-ba7a-7d39bed2d62f admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:02.632427 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92770d57-5708-4b61-95cd-24b9f032d6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:02.633107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92770d57-5708-4b61-95cd-24b9f032d6fa admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.633388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92770d57-5708-4b61-95cd-24b9f032d6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.633659 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92770d57-5708-4b61-95cd-24b9f032d6fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.634378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92770d57-5708-4b61-95cd-24b9f032d6fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:02.636170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92770d57-5708-4b61-95cd-24b9f032d6fa admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:02.646475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1261/2560] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:02.650919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abb76e-5a8d-42fb-84a5-382f85440435 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:02.661166 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68abb76e-5a8d-42fb-84a5-382f85440435 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:02.665672 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acb010f-16bc-4bdd-9815-cebe2082e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:02.667158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb010f-16bc-4bdd-9815-cebe2082e554 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.667442 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb010f-16bc-4bdd-9815-cebe2082e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.667717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acb010f-16bc-4bdd-9815-cebe2082e554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.668437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb010f-16bc-4bdd-9815-cebe2082e554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:02.670038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acb010f-16bc-4bdd-9815-cebe2082e554 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:02.679995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1300/2561] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:02.684011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92770d57-5708-4b61-95cd-24b9f032d6fa admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:02.693938 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92770d57-5708-4b61-95cd-24b9f032d6fa admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:02.698733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59d21a-3f0b-4958-a035-d7ee380aaf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:02.699701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d21a-3f0b-4958-a035-d7ee380aaf8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.699987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d21a-3f0b-4958-a035-d7ee380aaf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.700263 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59d21a-3f0b-4958-a035-d7ee380aaf8a admin admin] PATH_INFO: `/v3/projects/8c326bf3ed934eb5a5633ba37e1b738b/users/74f0abf840494cb18317a16d7f74e3eb/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.715139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59d21a-3f0b-4958-a035-d7ee380aaf8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c326bf3ed934eb5a5633ba37e1b738b, user_id=74f0abf840494cb18317a16d7f74e3eb, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:02.717805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59d21a-3f0b-4958-a035-d7ee380aaf8a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:02.731463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1262/2562] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:02 2022] PUT /identity/v3/projects/8c326bf3ed934eb5a5633ba37e1b738b/users/74f0abf840494cb18317a16d7f74e3eb/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:27:02.742629 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c30c29-f14b-4974-bf17-73ccca7eeb87 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.742919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c30c29-f14b-4974-bf17-73ccca7eeb87 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.743230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c30c29-f14b-4974-bf17-73ccca7eeb87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.769859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-97c30c29-f14b-4974-bf17-73ccca7eeb87 None None] MFA Rules not processed for user `74f0abf840494cb18317a16d7f74e3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:02.771089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-97c30c29-f14b-4974-bf17-73ccca7eeb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:02.834239 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1301/2563] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:02.839284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59d21a-3f0b-4958-a035-d7ee380aaf8a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:02.900215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59d21a-3f0b-4958-a035-d7ee380aaf8a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:02.905293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e37e7d-b89a-4ac2-b64c-c5889a2aeee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:02.905945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e37e7d-b89a-4ac2-b64c-c5889a2aeee1 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:02.906236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e37e7d-b89a-4ac2-b64c-c5889a2aeee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:02.906511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e37e7d-b89a-4ac2-b64c-c5889a2aeee1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:02.907251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e37e7d-b89a-4ac2-b64c-c5889a2aeee1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:02.909433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e37e7d-b89a-4ac2-b64c-c5889a2aeee1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:02.933238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1263/2564] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:27:02 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:27:02.937251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c30c29-f14b-4974-bf17-73ccca7eeb87 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:02.948577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c30c29-f14b-4974-bf17-73ccca7eeb87 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:02.960791 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:03.005612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2d422-c835-4050-8ad4-0db11d1753ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:03.006279 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2d422-c835-4050-8ad4-0db11d1753ab admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:03.006572 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2d422-c835-4050-8ad4-0db11d1753ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:03.006848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c2d422-c835-4050-8ad4-0db11d1753ab admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:03.007566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2d422-c835-4050-8ad4-0db11d1753ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:03.009516 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c2d422-c835-4050-8ad4-0db11d1753ab admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:03.029478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1302/2565] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:27:02 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:03.033731 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e37e7d-b89a-4ac2-b64c-c5889a2aeee1 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:03.044245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e37e7d-b89a-4ac2-b64c-c5889a2aeee1 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:03.049065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bb997-0ab7-4cdc-8e4b-1b1ab7ae5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:03.049773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bb997-0ab7-4cdc-8e4b-1b1ab7ae5210 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:03.050052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bb997-0ab7-4cdc-8e4b-1b1ab7ae5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:03.050327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bb997-0ab7-4cdc-8e4b-1b1ab7ae5210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:03.051108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bb997-0ab7-4cdc-8e4b-1b1ab7ae5210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:03.052747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bb997-0ab7-4cdc-8e4b-1b1ab7ae5210 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:03.063094 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1264/2566] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:03.067064 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2d422-c835-4050-8ad4-0db11d1753ab admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:03.079043 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c2d422-c835-4050-8ad4-0db11d1753ab admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:03.083875 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f097c-4acc-4f29-a4b4-d643655cd2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:03.084764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f097c-4acc-4f29-a4b4-d643655cd2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:03.085049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f097c-4acc-4f29-a4b4-d643655cd2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:03.085325 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762f097c-4acc-4f29-a4b4-d643655cd2c5 admin admin] PATH_INFO: `/v3/projects/d073f25518264cdc9bb9080143ec3462/users/050e49360f45495583d683e41f3dce16/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:03.103367 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f097c-4acc-4f29-a4b4-d643655cd2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d073f25518264cdc9bb9080143ec3462, user_id=050e49360f45495583d683e41f3dce16, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:03.106165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762f097c-4acc-4f29-a4b4-d643655cd2c5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:03.120631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1303/2567] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:03 2022] PUT /identity/v3/projects/d073f25518264cdc9bb9080143ec3462/users/050e49360f45495583d683e41f3dce16/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:03.124725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bb997-0ab7-4cdc-8e4b-1b1ab7ae5210 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:03.135745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bb997-0ab7-4cdc-8e4b-1b1ab7ae5210 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:03.170172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:03.200501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a1fac4-c41e-414e-8f8a-5105685772a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:03.201172 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fac4-c41e-414e-8f8a-5105685772a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:03.201578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fac4-c41e-414e-8f8a-5105685772a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:03.201871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a1fac4-c41e-414e-8f8a-5105685772a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:03.202622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1fac4-c41e-414e-8f8a-5105685772a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:03.204310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a1fac4-c41e-414e-8f8a-5105685772a1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:03.215891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1265/2568] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:03.220037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f097c-4acc-4f29-a4b4-d643655cd2c5 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:03.230382 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762f097c-4acc-4f29-a4b4-d643655cd2c5 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:03.234942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7c49e-324c-45aa-93f4-0ba2c1ea010e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:03.235842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c49e-324c-45aa-93f4-0ba2c1ea010e admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:03.236123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c49e-324c-45aa-93f4-0ba2c1ea010e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:03.236398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c7c49e-324c-45aa-93f4-0ba2c1ea010e admin admin] PATH_INFO: `/v3/projects/d073f25518264cdc9bb9080143ec3462/users/050e49360f45495583d683e41f3dce16/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:03.238722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7c49e-324c-45aa-93f4-0ba2c1ea010e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d073f25518264cdc9bb9080143ec3462, user_id=050e49360f45495583d683e41f3dce16, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:03.241411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c7c49e-324c-45aa-93f4-0ba2c1ea010e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:03.251898 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1304/2569] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:03 2022] PUT /identity/v3/projects/d073f25518264cdc9bb9080143ec3462/users/050e49360f45495583d683e41f3dce16/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:03.262411 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdba641-d838-4aca-a583-83556227b3ad None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:03.262704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdba641-d838-4aca-a583-83556227b3ad None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:03.263012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdba641-d838-4aca-a583-83556227b3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:03.289332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-5bdba641-d838-4aca-a583-83556227b3ad None None] MFA Rules not processed for user `050e49360f45495583d683e41f3dce16`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:03.290543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5bdba641-d838-4aca-a583-83556227b3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:03.359781 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1266/2570] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:03.371597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7c49e-324c-45aa-93f4-0ba2c1ea010e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:03.373411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-09c7c49e-324c-45aa-93f4-0ba2c1ea010e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:03.430726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c7c49e-324c-45aa-93f4-0ba2c1ea010e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:03.434605 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6166f345-5480-4730-bad6-eda34aba2821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:03.435276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f345-5480-4730-bad6-eda34aba2821 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:03.435561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f345-5480-4730-bad6-eda34aba2821 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:03.435839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6166f345-5480-4730-bad6-eda34aba2821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:03.444646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166f345-5480-4730-bad6-eda34aba2821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:03.446083 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6166f345-5480-4730-bad6-eda34aba2821 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:03.455474 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1305/2571] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:03.483149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdba641-d838-4aca-a583-83556227b3ad None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:03.545355 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdba641-d838-4aca-a583-83556227b3ad None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:03.550072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:03.551007 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:03.551290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:03.551594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] PATH_INFO: `/v3/users/74f0abf840494cb18317a16d7f74e3eb` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:03.552800 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74f0abf840494cb18317a16d7f74e3eb)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:03.554728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:03.599943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74f0abf840494cb18317a16d7f74e3eb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:03.600595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74f0abf840494cb18317a16d7f74e3eb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:03.601203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74f0abf840494cb18317a16d7f74e3eb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:03.608495 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74f0abf840494cb18317a16d7f74e3eb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:03.611972 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:03.615876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74f0abf840494cb18317a16d7f74e3eb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:03.634460 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1267/2572] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:03 2022] DELETE /identity/v3/users/74f0abf840494cb18317a16d7f74e3eb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:03.639734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544aa9a-d424-45d0-9861-c0b7ee56125f None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:03.640029 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544aa9a-d424-45d0-9861-c0b7ee56125f None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:03.640311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544aa9a-d424-45d0-9861-c0b7ee56125f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:03.658545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b544aa9a-d424-45d0-9861-c0b7ee56125f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:03.659771 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b544aa9a-d424-45d0-9861-c0b7ee56125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:03.717450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1306/2573] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:03.727074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:03.728575 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:03.786091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3430529-c32b-4f02-8216-80a1f3bae261 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:03.789802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c00027-c9b0-4cfc-8023-919bc0b1b7e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:03.790442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c00027-c9b0-4cfc-8023-919bc0b1b7e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:03.790738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c00027-c9b0-4cfc-8023-919bc0b1b7e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:03.791235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c00027-c9b0-4cfc-8023-919bc0b1b7e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:03.800366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c00027-c9b0-4cfc-8023-919bc0b1b7e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:03.801820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c00027-c9b0-4cfc-8023-919bc0b1b7e4 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:03.811255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1268/2574] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:04.070408 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544aa9a-d424-45d0-9861-c0b7ee56125f None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:04.073095 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b544aa9a-d424-45d0-9861-c0b7ee56125f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:04.085569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544aa9a-d424-45d0-9861-c0b7ee56125f None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:04.090100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:04.090980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:04.091270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:04.091579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] PATH_INFO: `/v3/projects/8c326bf3ed934eb5a5633ba37e1b738b` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:04.092810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c326bf3ed934eb5a5633ba37e1b738b)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:04.094730 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:04.103304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:04.142784 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c326bf3ed934eb5a5633ba37e1b738b', 'request_id': 'req-c7f65ff3-d473-4a55-88ed-35b265dece9d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.149648 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c326bf3ed934eb5a5633ba37e1b738b', 'request_id': 'req-c7f65ff3-d473-4a55-88ed-35b265dece9d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.155405 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c326bf3ed934eb5a5633ba37e1b738b', 'request_id': 'req-c7f65ff3-d473-4a55-88ed-35b265dece9d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.166417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] The token cache is being invalidate because project 8c326bf3ed934eb5a5633ba37e1b738b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:04.166700 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.167349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.168869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1307/2575] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:04 2022] DELETE /identity/v3/projects/8c326bf3ed934eb5a5633ba37e1b738b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:04.172945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c00027-c9b0-4cfc-8023-919bc0b1b7e4 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:04.183671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c00027-c9b0-4cfc-8023-919bc0b1b7e4 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:04.239476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:04.240335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:04.240617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:04.240892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] PATH_INFO: `/v3/users/050e49360f45495583d683e41f3dce16` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:04.242060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050e49360f45495583d683e41f3dce16)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:04.244678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:04.288866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050e49360f45495583d683e41f3dce16'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.289435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050e49360f45495583d683e41f3dce16'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.290030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050e49360f45495583d683e41f3dce16'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.297394 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050e49360f45495583d683e41f3dce16'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.303799 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-f0a5a478-670c-441e-bf1d-54dacfc44d76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050e49360f45495583d683e41f3dce16'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.317683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:04.322039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1269/2576] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:04 2022] DELETE /identity/v3/users/050e49360f45495583d683e41f3dce16 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:04.596546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:04.598010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:04.620551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f65ff3-d473-4a55-88ed-35b265dece9d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:04.682431 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:04.683327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:04.683610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:04.683913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] PATH_INFO: `/v3/projects/d073f25518264cdc9bb9080143ec3462` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:04.685124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d073f25518264cdc9bb9080143ec3462)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:04.687100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:04.733850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd073f25518264cdc9bb9080143ec3462', 'request_id': 'req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.740944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd073f25518264cdc9bb9080143ec3462', 'request_id': 'req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.746499 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd073f25518264cdc9bb9080143ec3462', 'request_id': 'req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.757393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] The token cache is being invalidate because project d073f25518264cdc9bb9080143ec3462 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:04.757690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.758316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f226c7b0-dbda-4de4-97a5-ec1acaa7fdec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:04.760594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1308/2577] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:04 2022] DELETE /identity/v3/projects/d073f25518264cdc9bb9080143ec3462 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:04.764773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640adf-2b84-44b4-afa7-87db483b5d79 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:04.765063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640adf-2b84-44b4-afa7-87db483b5d79 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:04.765364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26640adf-2b84-44b4-afa7-87db483b5d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:04.784116 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-26640adf-2b84-44b4-afa7-87db483b5d79 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:04.785308 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-26640adf-2b84-44b4-afa7-87db483b5d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:04.843730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1270/2578] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:04.851404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e22be-317f-46e1-b3c4-0b2eece45428 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:04.851697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e22be-317f-46e1-b3c4-0b2eece45428 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:04.851981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e22be-317f-46e1-b3c4-0b2eece45428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:04.870513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-f51e22be-317f-46e1-b3c4-0b2eece45428 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:04.871747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f51e22be-317f-46e1-b3c4-0b2eece45428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:04.879610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1309/2579] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:04.883584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26640adf-2b84-44b4-afa7-87db483b5d79 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:04.893901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26640adf-2b84-44b4-afa7-87db483b5d79 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:04.898464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898981-9565-43e6-b046-3a0231d0dddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:04.899138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898981-9565-43e6-b046-3a0231d0dddc admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:04.899422 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898981-9565-43e6-b046-3a0231d0dddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:04.899695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23898981-9565-43e6-b046-3a0231d0dddc admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:04.901016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23898981-9565-43e6-b046-3a0231d0dddc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:27:04.901317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23898981-9565-43e6-b046-3a0231d0dddc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:04.903216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23898981-9565-43e6-b046-3a0231d0dddc admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:04.915226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1271/2580] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:27:04.919979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e22be-317f-46e1-b3c4-0b2eece45428 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:04.929055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e22be-317f-46e1-b3c4-0b2eece45428 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:04.933721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8718e-2899-4224-a273-43bc6c1c3d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:04.934358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8718e-2899-4224-a273-43bc6c1c3d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:04.934642 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8718e-2899-4224-a273-43bc6c1c3d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:04.934917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8718e-2899-4224-a273-43bc6c1c3d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:04.935624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8718e-2899-4224-a273-43bc6c1c3d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:04.937521 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8718e-2899-4224-a273-43bc6c1c3d3f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:04.955403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:04.964850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1310/2581] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:27:04 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:27:04.968883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898981-9565-43e6-b046-3a0231d0dddc admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:04.980093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23898981-9565-43e6-b046-3a0231d0dddc admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.037285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bce6b-e338-497d-b29b-4f89c9f2d916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.037944 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bce6b-e338-497d-b29b-4f89c9f2d916 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.038227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bce6b-e338-497d-b29b-4f89c9f2d916 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.038502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9bce6b-e338-497d-b29b-4f89c9f2d916 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.039204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bce6b-e338-497d-b29b-4f89c9f2d916 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.041205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9bce6b-e338-497d-b29b-4f89c9f2d916 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.060010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1272/2582] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:27:04 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:05.064114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8718e-2899-4224-a273-43bc6c1c3d3f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:05.074941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8718e-2899-4224-a273-43bc6c1c3d3f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.079706 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78affb-341f-450e-b912-1d4325afd4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.080364 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78affb-341f-450e-b912-1d4325afd4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.080653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78affb-341f-450e-b912-1d4325afd4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.080939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed78affb-341f-450e-b912-1d4325afd4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.081695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78affb-341f-450e-b912-1d4325afd4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.083359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed78affb-341f-450e-b912-1d4325afd4bf admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.094435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1311/2583] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:05.098228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bce6b-e338-497d-b29b-4f89c9f2d916 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:05.108395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9bce6b-e338-497d-b29b-4f89c9f2d916 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.113528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe93518-d012-4593-8e88-c00d517166f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.114185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe93518-d012-4593-8e88-c00d517166f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.114497 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe93518-d012-4593-8e88-c00d517166f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.114943 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe93518-d012-4593-8e88-c00d517166f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.115853 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe93518-d012-4593-8e88-c00d517166f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.117471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe93518-d012-4593-8e88-c00d517166f4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.129194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1273/2584] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:27:05.132756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78affb-341f-450e-b912-1d4325afd4bf admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:05.143274 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed78affb-341f-450e-b912-1d4325afd4bf admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.147867 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10319034-cc23-41b1-b30d-fae77670309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.148748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319034-cc23-41b1-b30d-fae77670309e admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.149032 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319034-cc23-41b1-b30d-fae77670309e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.149311 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10319034-cc23-41b1-b30d-fae77670309e admin admin] PATH_INFO: `/v3/projects/9b5f6b1d4c9c4deb9c85b08e7f4fd01b/users/f919dcfa2ce944e5a9775b4b08b5ef85/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.164932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10319034-cc23-41b1-b30d-fae77670309e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b5f6b1d4c9c4deb9c85b08e7f4fd01b, user_id=f919dcfa2ce944e5a9775b4b08b5ef85, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.167645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10319034-cc23-41b1-b30d-fae77670309e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.184629 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1312/2585] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:05 2022] PUT /identity/v3/projects/9b5f6b1d4c9c4deb9c85b08e7f4fd01b/users/f919dcfa2ce944e5a9775b4b08b5ef85/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:05.191985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881b2d7-bfd4-40ad-8dea-6436f5a29ecc None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.192375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881b2d7-bfd4-40ad-8dea-6436f5a29ecc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.192550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881b2d7-bfd4-40ad-8dea-6436f5a29ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.220285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-5881b2d7-bfd4-40ad-8dea-6436f5a29ecc None None] MFA Rules not processed for user `f919dcfa2ce944e5a9775b4b08b5ef85`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:05.221493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5881b2d7-bfd4-40ad-8dea-6436f5a29ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:05.276319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:05.285817 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1274/2586] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:05.290334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10319034-cc23-41b1-b30d-fae77670309e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:05.353332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10319034-cc23-41b1-b30d-fae77670309e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.357909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e21348-3359-41a7-89c8-2a33826c63e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.358556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e21348-3359-41a7-89c8-2a33826c63e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.358840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e21348-3359-41a7-89c8-2a33826c63e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.359148 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e21348-3359-41a7-89c8-2a33826c63e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.359836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e21348-3359-41a7-89c8-2a33826c63e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.361752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e21348-3359-41a7-89c8-2a33826c63e0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.387276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1313/2587] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:27:05 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:05.391073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881b2d7-bfd4-40ad-8dea-6436f5a29ecc None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:05.401784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881b2d7-bfd4-40ad-8dea-6436f5a29ecc None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.458320 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362b41-e338-4daf-99fd-4fb48758ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.459016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362b41-e338-4daf-99fd-4fb48758ba55 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.459309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362b41-e338-4daf-99fd-4fb48758ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.459588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d362b41-e338-4daf-99fd-4fb48758ba55 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.460287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d362b41-e338-4daf-99fd-4fb48758ba55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.462233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d362b41-e338-4daf-99fd-4fb48758ba55 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.481928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1275/2588] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:27:05 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:27:05.485774 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e21348-3359-41a7-89c8-2a33826c63e0 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:05.496553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e21348-3359-41a7-89c8-2a33826c63e0 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.501067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef7274-b042-4e97-bea2-12672c291e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.501716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef7274-b042-4e97-bea2-12672c291e12 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.501999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef7274-b042-4e97-bea2-12672c291e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.502277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eef7274-b042-4e97-bea2-12672c291e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.503052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef7274-b042-4e97-bea2-12672c291e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.504653 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eef7274-b042-4e97-bea2-12672c291e12 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.515958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1314/2589] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:05.520030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362b41-e338-4daf-99fd-4fb48758ba55 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:05.530636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d362b41-e338-4daf-99fd-4fb48758ba55 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.535490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5681-3b31-405a-9909-36588a89a065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.536367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5681-3b31-405a-9909-36588a89a065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.536657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5681-3b31-405a-9909-36588a89a065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.536933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d5681-3b31-405a-9909-36588a89a065 admin admin] PATH_INFO: `/v3/projects/eaa6aecfc4984425a241f90c0fde4b5e/users/283d8e9aa6f640d88f195721d22f01be/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.553246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5681-3b31-405a-9909-36588a89a065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa6aecfc4984425a241f90c0fde4b5e, user_id=283d8e9aa6f640d88f195721d22f01be, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.555968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d5681-3b31-405a-9909-36588a89a065 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.568969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1276/2590] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:05 2022] PUT /identity/v3/projects/eaa6aecfc4984425a241f90c0fde4b5e/users/283d8e9aa6f640d88f195721d22f01be/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:05.573448 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef7274-b042-4e97-bea2-12672c291e12 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:05.583230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eef7274-b042-4e97-bea2-12672c291e12 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.639748 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ad123-b88a-4fd8-8b3b-05b4dee3c51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.640381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ad123-b88a-4fd8-8b3b-05b4dee3c51b admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.640610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ad123-b88a-4fd8-8b3b-05b4dee3c51b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.640893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ad123-b88a-4fd8-8b3b-05b4dee3c51b admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.641606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ad123-b88a-4fd8-8b3b-05b4dee3c51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.643235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ad123-b88a-4fd8-8b3b-05b4dee3c51b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.653226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1315/2591] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:27:05.657399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5681-3b31-405a-9909-36588a89a065 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:05.667778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d5681-3b31-405a-9909-36588a89a065 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.672402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d1f2b-d164-415f-98d9-e7e7d90f3227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.673302 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1f2b-d164-415f-98d9-e7e7d90f3227 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.673579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1f2b-d164-415f-98d9-e7e7d90f3227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.673874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d1f2b-d164-415f-98d9-e7e7d90f3227 admin admin] PATH_INFO: `/v3/projects/eaa6aecfc4984425a241f90c0fde4b5e/users/283d8e9aa6f640d88f195721d22f01be/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.675860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d1f2b-d164-415f-98d9-e7e7d90f3227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaa6aecfc4984425a241f90c0fde4b5e, user_id=283d8e9aa6f640d88f195721d22f01be, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.678488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d1f2b-d164-415f-98d9-e7e7d90f3227 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.689125 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1277/2592] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:05 2022] PUT /identity/v3/projects/eaa6aecfc4984425a241f90c0fde4b5e/users/283d8e9aa6f640d88f195721d22f01be/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:05.699794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757884ac-ce07-4cd8-b846-5af6b5f454c1 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.700074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757884ac-ce07-4cd8-b846-5af6b5f454c1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.700355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757884ac-ce07-4cd8-b846-5af6b5f454c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.726292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-757884ac-ce07-4cd8-b846-5af6b5f454c1 None None] MFA Rules not processed for user `283d8e9aa6f640d88f195721d22f01be`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:05.727516 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-757884ac-ce07-4cd8-b846-5af6b5f454c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:05.748275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:05.796807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1316/2593] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:05.809401 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d1f2b-d164-415f-98d9-e7e7d90f3227 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:05.811507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-274d1f2b-d164-415f-98d9-e7e7d90f3227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:05.868150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d1f2b-d164-415f-98d9-e7e7d90f3227 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:05.872884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4c12b-aa41-4174-ac5e-6afcfcc8bed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:05.873518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4c12b-aa41-4174-ac5e-6afcfcc8bed0 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:05.873802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4c12b-aa41-4174-ac5e-6afcfcc8bed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:05.874076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4c12b-aa41-4174-ac5e-6afcfcc8bed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:05.882998 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4c12b-aa41-4174-ac5e-6afcfcc8bed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:05.884451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4c12b-aa41-4174-ac5e-6afcfcc8bed0 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:05.896129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1278/2594] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:05 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:06.196872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757884ac-ce07-4cd8-b846-5af6b5f454c1 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:06.206133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757884ac-ce07-4cd8-b846-5af6b5f454c1 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:06.210861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c06a0-e812-4828-b8e9-f50f2a45f4ad tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283d8e9aa6f640d88f195721d22f01be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa6aecfc4984425a241f90c0fde4b5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:06.211550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c06a0-e812-4828-b8e9-f50f2a45f4ad tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:06.211836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c06a0-e812-4828-b8e9-f50f2a45f4ad tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:06.212121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c06a0-e812-4828-b8e9-f50f2a45f4ad tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:06.213548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c06a0-e812-4828-b8e9-f50f2a45f4ad tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:27:06.213864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c06a0-e812-4828-b8e9-f50f2a45f4ad tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:06.215553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c06a0-e812-4828-b8e9-f50f2a45f4ad tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:06.227480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1317/2595] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:27:06.231684 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4c12b-aa41-4174-ac5e-6afcfcc8bed0 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:06.240809 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4c12b-aa41-4174-ac5e-6afcfcc8bed0 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:06.245884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25887a-d864-4e75-998c-69d518b4f704 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283d8e9aa6f640d88f195721d22f01be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa6aecfc4984425a241f90c0fde4b5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:06.246530 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25887a-d864-4e75-998c-69d518b4f704 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:06.246821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25887a-d864-4e75-998c-69d518b4f704 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:06.247143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c25887a-d864-4e75-998c-69d518b4f704 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:06.247843 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25887a-d864-4e75-998c-69d518b4f704 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:06.249762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c25887a-d864-4e75-998c-69d518b4f704 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:06.275082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1279/2596] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:27:06 2022] POST /identity/v3/projects => generated 355 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:06.279619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c06a0-e812-4828-b8e9-f50f2a45f4ad tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:06.291769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c06a0-e812-4828-b8e9-f50f2a45f4ad tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:06.348927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51087e1-7dde-4edd-9c1d-98cc390a4fed tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283d8e9aa6f640d88f195721d22f01be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa6aecfc4984425a241f90c0fde4b5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:06.349597 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51087e1-7dde-4edd-9c1d-98cc390a4fed tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:06.349890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51087e1-7dde-4edd-9c1d-98cc390a4fed tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:06.350172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51087e1-7dde-4edd-9c1d-98cc390a4fed tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:06.350894 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51087e1-7dde-4edd-9c1d-98cc390a4fed tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:27:06.351236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51087e1-7dde-4edd-9c1d-98cc390a4fed tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:06.352846 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51087e1-7dde-4edd-9c1d-98cc390a4fed tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:06.364357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1318/2597] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:27:06.401293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25887a-d864-4e75-998c-69d518b4f704 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:06.412887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c25887a-d864-4e75-998c-69d518b4f704 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:06.418096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '283d8e9aa6f640d88f195721d22f01be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eaa6aecfc4984425a241f90c0fde4b5e', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:06.418934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:06.419262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:06.419542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] PATH_INFO: `/v3/projects/cf3e7049d95a42dc89fb9a861221cc88` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:06.420743 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cf3e7049d95a42dc89fb9a861221cc88)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:06.422690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:06.449262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:06.472039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf3e7049d95a42dc89fb9a861221cc88', 'request_id': 'req-cdfa663e-765f-46d8-beba-493901bc7d84'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:06.480215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf3e7049d95a42dc89fb9a861221cc88', 'request_id': 'req-cdfa663e-765f-46d8-beba-493901bc7d84'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:06.485768 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf3e7049d95a42dc89fb9a861221cc88', 'request_id': 'req-cdfa663e-765f-46d8-beba-493901bc7d84'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:06.497737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] The token cache is being invalidate because project cf3e7049d95a42dc89fb9a861221cc88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:06.498029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:06.498674 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cdfa663e-765f-46d8-beba-493901bc7d84 tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:06.500226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1280/2598] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:06 2022] DELETE /identity/v3/projects/cf3e7049d95a42dc89fb9a861221cc88 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:06.693443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51087e1-7dde-4edd-9c1d-98cc390a4fed tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:06.695310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-f51087e1-7dde-4edd-9c1d-98cc390a4fed tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:06.759228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51087e1-7dde-4edd-9c1d-98cc390a4fed tempest-VolumeQuotaClassesTest-1144761643 tempest-VolumeQuotaClassesTest-1144761643-project-admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:06.802120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:06.815359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:06.816259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:06.816543 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:06.816821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] PATH_INFO: `/v3/users/f919dcfa2ce944e5a9775b4b08b5ef85` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:06.818051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f919dcfa2ce944e5a9775b4b08b5ef85)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:06.820017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:06.865545 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f919dcfa2ce944e5a9775b4b08b5ef85'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:06.866187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f919dcfa2ce944e5a9775b4b08b5ef85'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:06.866807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f919dcfa2ce944e5a9775b4b08b5ef85'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:06.873810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f919dcfa2ce944e5a9775b4b08b5ef85'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:06.881987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f919dcfa2ce944e5a9775b4b08b5ef85'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:06.899148 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1319/2599] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:06 2022] DELETE /identity/v3/users/f919dcfa2ce944e5a9775b4b08b5ef85 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:06.904281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5674ae-4b9f-4e8d-b15b-a3cf98e17769 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:06.904566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5674ae-4b9f-4e8d-b15b-a3cf98e17769 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:06.904838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5674ae-4b9f-4e8d-b15b-a3cf98e17769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:06.924043 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7e5674ae-4b9f-4e8d-b15b-a3cf98e17769 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:06.925177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7e5674ae-4b9f-4e8d-b15b-a3cf98e17769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:06.984883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1281/2600] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:06.995259 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:06.996778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:07.053478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002d592-b042-4750-9f78-12f17e65e020 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:07.057655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbf405-82e3-4394-be63-82a0f528b441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:07.058267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbf405-82e3-4394-be63-82a0f528b441 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:07.058546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbf405-82e3-4394-be63-82a0f528b441 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:07.058826 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbf405-82e3-4394-be63-82a0f528b441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:07.067715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbf405-82e3-4394-be63-82a0f528b441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:07.069162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bbf405-82e3-4394-be63-82a0f528b441 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:07.079219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1320/2601] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:07.375091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5674ae-4b9f-4e8d-b15b-a3cf98e17769 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:07.376806 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7e5674ae-4b9f-4e8d-b15b-a3cf98e17769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:07.389876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5674ae-4b9f-4e8d-b15b-a3cf98e17769 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:07.394598 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:07.395580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:07.395929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:07.396241 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] PATH_INFO: `/v3/projects/9b5f6b1d4c9c4deb9c85b08e7f4fd01b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:07.397433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b5f6b1d4c9c4deb9c85b08e7f4fd01b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:07.399427 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:07.446948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b5f6b1d4c9c4deb9c85b08e7f4fd01b', 'request_id': 'req-914b75cd-574b-4616-8b12-00c5ad4281ea'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:07.453303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b5f6b1d4c9c4deb9c85b08e7f4fd01b', 'request_id': 'req-914b75cd-574b-4616-8b12-00c5ad4281ea'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:07.458869 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b5f6b1d4c9c4deb9c85b08e7f4fd01b', 'request_id': 'req-914b75cd-574b-4616-8b12-00c5ad4281ea'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:07.469750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] The token cache is being invalidate because project 9b5f6b1d4c9c4deb9c85b08e7f4fd01b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:07.470040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:07.470673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:07.472214 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1282/2602] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:07 2022] DELETE /identity/v3/projects/9b5f6b1d4c9c4deb9c85b08e7f4fd01b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:07.476207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbf405-82e3-4394-be63-82a0f528b441 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:07.486335 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbf405-82e3-4394-be63-82a0f528b441 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:07.543113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:07.543982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:07.544266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:07.544546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] PATH_INFO: `/v3/users/283d8e9aa6f640d88f195721d22f01be` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:07.545736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283d8e9aa6f640d88f195721d22f01be)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:07.547710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:07.558610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:07.594666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283d8e9aa6f640d88f195721d22f01be'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:07.595318 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283d8e9aa6f640d88f195721d22f01be'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:07.595908 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283d8e9aa6f640d88f195721d22f01be'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:07.602525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283d8e9aa6f640d88f195721d22f01be'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:07.610253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-0b983da2-ebe0-458d-99f0-c32f3510df04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283d8e9aa6f640d88f195721d22f01be'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:07.627551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1321/2603] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:07 2022] DELETE /identity/v3/users/283d8e9aa6f640d88f195721d22f01be => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:07.902901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:07.904434 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:07.918545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b75cd-574b-4616-8b12-00c5ad4281ea admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:07.951453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:07.977373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:07.978252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:07.978537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:07.978816 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] PATH_INFO: `/v3/projects/eaa6aecfc4984425a241f90c0fde4b5e` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:07.980045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaa6aecfc4984425a241f90c0fde4b5e)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:07.981950 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.028510 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaa6aecfc4984425a241f90c0fde4b5e', 'request_id': 'req-2de9e247-074c-4161-a9f9-552321ed6ff0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:08.034914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaa6aecfc4984425a241f90c0fde4b5e', 'request_id': 'req-2de9e247-074c-4161-a9f9-552321ed6ff0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:08.040258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaa6aecfc4984425a241f90c0fde4b5e', 'request_id': 'req-2de9e247-074c-4161-a9f9-552321ed6ff0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:08.050872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] The token cache is being invalidate because project eaa6aecfc4984425a241f90c0fde4b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:08.051184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:08.051808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2de9e247-074c-4161-a9f9-552321ed6ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:08.053313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1283/2604] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:07 2022] DELETE /identity/v3/projects/eaa6aecfc4984425a241f90c0fde4b5e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:08.058169 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab92ab-1827-44ba-bd96-711ffb3aae95 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.058650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab92ab-1827-44ba-bd96-711ffb3aae95 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.058747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab92ab-1827-44ba-bd96-711ffb3aae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.078943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-4bab92ab-1827-44ba-bd96-711ffb3aae95 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:08.080154 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4bab92ab-1827-44ba-bd96-711ffb3aae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:08.140036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1322/2605] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:08.147787 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8135816-1414-4ac3-bd43-319a671c670b None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.148077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8135816-1414-4ac3-bd43-319a671c670b None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.148353 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8135816-1414-4ac3-bd43-319a671c670b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.167454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-c8135816-1414-4ac3-bd43-319a671c670b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:08.168641 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-c8135816-1414-4ac3-bd43-319a671c670b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:08.176398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1284/2606] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:27:08.180419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab92ab-1827-44ba-bd96-711ffb3aae95 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.190744 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab92ab-1827-44ba-bd96-711ffb3aae95 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.195427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537a47f-32a8-431f-bb09-127e5ad71b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.196088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537a47f-32a8-431f-bb09-127e5ad71b5d admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.196403 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537a47f-32a8-431f-bb09-127e5ad71b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.196685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4537a47f-32a8-431f-bb09-127e5ad71b5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.197425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537a47f-32a8-431f-bb09-127e5ad71b5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:27:08.197731 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537a47f-32a8-431f-bb09-127e5ad71b5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.199387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4537a47f-32a8-431f-bb09-127e5ad71b5d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.211677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1323/2607] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:27:08.216277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8135816-1414-4ac3-bd43-319a671c670b None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.225580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8135816-1414-4ac3-bd43-319a671c670b None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.230862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c54a3c-e47c-4739-9ff9-90f3bb39a5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.231481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c54a3c-e47c-4739-9ff9-90f3bb39a5a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.231766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c54a3c-e47c-4739-9ff9-90f3bb39a5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.232045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c54a3c-e47c-4739-9ff9-90f3bb39a5a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.232740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c54a3c-e47c-4739-9ff9-90f3bb39a5a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.234637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c54a3c-e47c-4739-9ff9-90f3bb39a5a0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.260332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1285/2608] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:27:08 2022] POST /identity/v3/projects => generated 377 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:27:08.264350 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537a47f-32a8-431f-bb09-127e5ad71b5d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.274353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4537a47f-32a8-431f-bb09-127e5ad71b5d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.330483 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbdcbd-8fea-4f56-99e1-6e27bc381dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.331171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbdcbd-8fea-4f56-99e1-6e27bc381dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.331453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbdcbd-8fea-4f56-99e1-6e27bc381dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.331729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cbdcbd-8fea-4f56-99e1-6e27bc381dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.332406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbdcbd-8fea-4f56-99e1-6e27bc381dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.334362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cbdcbd-8fea-4f56-99e1-6e27bc381dd6 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.354076 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1324/2609] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:27:08 2022] POST /identity/v3/users => generated 289 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:08.358396 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c54a3c-e47c-4739-9ff9-90f3bb39a5a0 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.368511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c54a3c-e47c-4739-9ff9-90f3bb39a5a0 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.373259 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051349b-046d-43d3-ae10-f52284678acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.373905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051349b-046d-43d3-ae10-f52284678acb admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.374187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051349b-046d-43d3-ae10-f52284678acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.374461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051349b-046d-43d3-ae10-f52284678acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.375217 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051349b-046d-43d3-ae10-f52284678acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.376803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051349b-046d-43d3-ae10-f52284678acb admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.387233 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1286/2610] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:08.391030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbdcbd-8fea-4f56-99e1-6e27bc381dd6 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.397303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:08.401801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cbdcbd-8fea-4f56-99e1-6e27bc381dd6 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.407507 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b831093e-7044-4151-a1a7-04e446f19968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.408591 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831093e-7044-4151-a1a7-04e446f19968 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.409050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831093e-7044-4151-a1a7-04e446f19968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.409451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b831093e-7044-4151-a1a7-04e446f19968 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.410338 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831093e-7044-4151-a1a7-04e446f19968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.411982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b831093e-7044-4151-a1a7-04e446f19968 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.424396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1325/2611] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:08.428462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051349b-046d-43d3-ae10-f52284678acb admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.438331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051349b-046d-43d3-ae10-f52284678acb admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.443132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510ea8-5acb-48a6-9d25-a41bb65c1253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.444011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510ea8-5acb-48a6-9d25-a41bb65c1253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.444296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510ea8-5acb-48a6-9d25-a41bb65c1253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.444572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8510ea8-5acb-48a6-9d25-a41bb65c1253 admin admin] PATH_INFO: `/v3/projects/66347fccdbc7486fb933ed5950fd1b82/users/2063d7c061c347f29dd18fe2b4e545b5/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.458761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8510ea8-5acb-48a6-9d25-a41bb65c1253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66347fccdbc7486fb933ed5950fd1b82, user_id=2063d7c061c347f29dd18fe2b4e545b5, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.461457 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8510ea8-5acb-48a6-9d25-a41bb65c1253 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.474470 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1287/2612] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:08 2022] PUT /identity/v3/projects/66347fccdbc7486fb933ed5950fd1b82/users/2063d7c061c347f29dd18fe2b4e545b5/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:27:08.486338 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077d534-9718-4550-87a6-12299f1b1265 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.486569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077d534-9718-4550-87a6-12299f1b1265 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.486850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077d534-9718-4550-87a6-12299f1b1265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.512240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-1077d534-9718-4550-87a6-12299f1b1265 None None] MFA Rules not processed for user `2063d7c061c347f29dd18fe2b4e545b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:08.513456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-1077d534-9718-4550-87a6-12299f1b1265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:08.578496 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1326/2613] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:08.582893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510ea8-5acb-48a6-9d25-a41bb65c1253 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.646186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8510ea8-5acb-48a6-9d25-a41bb65c1253 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.651116 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc5681-ca52-4437-b7d5-a9f260372bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.651801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc5681-ca52-4437-b7d5-a9f260372bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.652087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc5681-ca52-4437-b7d5-a9f260372bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.652364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becc5681-ca52-4437-b7d5-a9f260372bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.653088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc5681-ca52-4437-b7d5-a9f260372bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.655013 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becc5681-ca52-4437-b7d5-a9f260372bf7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.659236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:08.680455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1288/2614] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:27:08 2022] POST /identity/v3/projects => generated 379 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:27:08.685090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077d534-9718-4550-87a6-12299f1b1265 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.696916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077d534-9718-4550-87a6-12299f1b1265 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.753534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5f248-cb62-4131-bad8-d47eaf4d9a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.754120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5f248-cb62-4131-bad8-d47eaf4d9a2b admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.754404 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5f248-cb62-4131-bad8-d47eaf4d9a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.754677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c5f248-cb62-4131-bad8-d47eaf4d9a2b admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.755386 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5f248-cb62-4131-bad8-d47eaf4d9a2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.757297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c5f248-cb62-4131-bad8-d47eaf4d9a2b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.776023 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1327/2615] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:27:08 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:08.779887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc5681-ca52-4437-b7d5-a9f260372bf7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.790186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becc5681-ca52-4437-b7d5-a9f260372bf7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.795361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2fba8-159e-4bf7-b7a3-6f06de903508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.796009 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2fba8-159e-4bf7-b7a3-6f06de903508 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.796291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2fba8-159e-4bf7-b7a3-6f06de903508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.796565 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c2fba8-159e-4bf7-b7a3-6f06de903508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.797301 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2fba8-159e-4bf7-b7a3-6f06de903508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.798885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c2fba8-159e-4bf7-b7a3-6f06de903508 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.810725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1289/2616] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:08.814522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5f248-cb62-4131-bad8-d47eaf4d9a2b admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.824579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c5f248-cb62-4131-bad8-d47eaf4d9a2b admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.829210 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cfdd2-3e7f-4898-aa61-79f9a94e012e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.829860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cfdd2-3e7f-4898-aa61-79f9a94e012e admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.830171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cfdd2-3e7f-4898-aa61-79f9a94e012e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.830477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cfdd2-3e7f-4898-aa61-79f9a94e012e admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.831360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cfdd2-3e7f-4898-aa61-79f9a94e012e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.832982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cfdd2-3e7f-4898-aa61-79f9a94e012e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.843067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1328/2617] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:08.846878 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2fba8-159e-4bf7-b7a3-6f06de903508 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:08.857176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c2fba8-159e-4bf7-b7a3-6f06de903508 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:08.861683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70eee9-7bbf-458f-b2bf-0f5839acf355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:08.862546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70eee9-7bbf-458f-b2bf-0f5839acf355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.862825 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70eee9-7bbf-458f-b2bf-0f5839acf355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.863128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70eee9-7bbf-458f-b2bf-0f5839acf355 admin admin] PATH_INFO: `/v3/projects/1be91753d6b445a099a038dd78432224/users/3e63d009dbc144ba80c931dfe7b28b21/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.878061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70eee9-7bbf-458f-b2bf-0f5839acf355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1be91753d6b445a099a038dd78432224, user_id=3e63d009dbc144ba80c931dfe7b28b21, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:08.880752 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70eee9-7bbf-458f-b2bf-0f5839acf355 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:08.893211 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1290/2618] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:08 2022] PUT /identity/v3/projects/1be91753d6b445a099a038dd78432224/users/3e63d009dbc144ba80c931dfe7b28b21/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:27:08.903328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcea8d7-ceae-4689-923b-3e093dedb1f8 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:08.903624 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcea8d7-ceae-4689-923b-3e093dedb1f8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:08.903931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcea8d7-ceae-4689-923b-3e093dedb1f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:08.930450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-0dcea8d7-ceae-4689-923b-3e093dedb1f8 None None] MFA Rules not processed for user `3e63d009dbc144ba80c931dfe7b28b21`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:08.931701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0dcea8d7-ceae-4689-923b-3e093dedb1f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:08.983194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:09.001729 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1329/2619] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:09.006543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70eee9-7bbf-458f-b2bf-0f5839acf355 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:09.068016 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70eee9-7bbf-458f-b2bf-0f5839acf355 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:09.072645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75edc39-c949-43f2-9f78-66b4a1745198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:09.073333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75edc39-c949-43f2-9f78-66b4a1745198 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:09.073622 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75edc39-c949-43f2-9f78-66b4a1745198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:09.073899 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75edc39-c949-43f2-9f78-66b4a1745198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:09.074594 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75edc39-c949-43f2-9f78-66b4a1745198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:09.076536 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75edc39-c949-43f2-9f78-66b4a1745198 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:09.102115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1291/2620] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:27:09 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:09.107359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcea8d7-ceae-4689-923b-3e093dedb1f8 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:09.117899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcea8d7-ceae-4689-923b-3e093dedb1f8 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:09.178987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bbe51-15d0-4408-a841-93d40468845c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:09.179675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bbe51-15d0-4408-a841-93d40468845c admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:09.179962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bbe51-15d0-4408-a841-93d40468845c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:09.180238 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bbe51-15d0-4408-a841-93d40468845c admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:09.180931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bbe51-15d0-4408-a841-93d40468845c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:09.182923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4bbe51-15d0-4408-a841-93d40468845c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:09.203047 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1330/2621] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:27:09 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:09.207183 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75edc39-c949-43f2-9f78-66b4a1745198 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:09.218221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75edc39-c949-43f2-9f78-66b4a1745198 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:09.222920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f18ba2-186b-4716-9472-9f9e2196d123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:09.223608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f18ba2-186b-4716-9472-9f9e2196d123 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:09.223893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f18ba2-186b-4716-9472-9f9e2196d123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:09.224171 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f18ba2-186b-4716-9472-9f9e2196d123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:09.224898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f18ba2-186b-4716-9472-9f9e2196d123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:09.226499 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f18ba2-186b-4716-9472-9f9e2196d123 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:09.237531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1292/2622] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:27:09.241665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bbe51-15d0-4408-a841-93d40468845c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:09.251843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bbe51-15d0-4408-a841-93d40468845c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:09.256513 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50371a0-795d-4d04-9227-7b83c57d66e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:09.257443 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50371a0-795d-4d04-9227-7b83c57d66e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:09.257677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50371a0-795d-4d04-9227-7b83c57d66e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:09.257957 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50371a0-795d-4d04-9227-7b83c57d66e7 admin admin] PATH_INFO: `/v3/projects/ce69e4e8fc3943b0a70d77956dd31b9a/users/7f2e289c2d5341e092e0ef48eca59815/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:09.272751 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50371a0-795d-4d04-9227-7b83c57d66e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce69e4e8fc3943b0a70d77956dd31b9a, user_id=7f2e289c2d5341e092e0ef48eca59815, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:09.275486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50371a0-795d-4d04-9227-7b83c57d66e7 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:09.289692 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1331/2623] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:09 2022] PUT /identity/v3/projects/ce69e4e8fc3943b0a70d77956dd31b9a/users/7f2e289c2d5341e092e0ef48eca59815/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:27:09.294111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f18ba2-186b-4716-9472-9f9e2196d123 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:09.303963 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f18ba2-186b-4716-9472-9f9e2196d123 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:09.361400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a98bfaf-9919-41d4-8372-ff69e2cff32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:09.362066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98bfaf-9919-41d4-8372-ff69e2cff32a admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:09.362357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98bfaf-9919-41d4-8372-ff69e2cff32a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:09.362637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a98bfaf-9919-41d4-8372-ff69e2cff32a admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:09.363400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98bfaf-9919-41d4-8372-ff69e2cff32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:09.365017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a98bfaf-9919-41d4-8372-ff69e2cff32a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:09.375135 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1293/2624] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:09.379525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50371a0-795d-4d04-9227-7b83c57d66e7 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:09.392010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50371a0-795d-4d04-9227-7b83c57d66e7 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:09.397012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515b222-10a3-40b7-a2e4-f44ed6ef7b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:09.397928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b222-10a3-40b7-a2e4-f44ed6ef7b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:09.398214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b222-10a3-40b7-a2e4-f44ed6ef7b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:09.398494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7515b222-10a3-40b7-a2e4-f44ed6ef7b16 admin admin] PATH_INFO: `/v3/projects/ce69e4e8fc3943b0a70d77956dd31b9a/users/7f2e289c2d5341e092e0ef48eca59815/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:09.400508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515b222-10a3-40b7-a2e4-f44ed6ef7b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce69e4e8fc3943b0a70d77956dd31b9a, user_id=7f2e289c2d5341e092e0ef48eca59815, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:09.403227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7515b222-10a3-40b7-a2e4-f44ed6ef7b16 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:09.413609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1332/2625] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:09 2022] PUT /identity/v3/projects/ce69e4e8fc3943b0a70d77956dd31b9a/users/7f2e289c2d5341e092e0ef48eca59815/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:09.425246 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b6a9-fcda-4b61-a62e-7bd6f56cdf7d None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:09.425757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b6a9-fcda-4b61-a62e-7bd6f56cdf7d None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:09.425875 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b6a9-fcda-4b61-a62e-7bd6f56cdf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:09.453262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-cbf5b6a9-fcda-4b61-a62e-7bd6f56cdf7d None None] MFA Rules not processed for user `7f2e289c2d5341e092e0ef48eca59815`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:09.454489 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-cbf5b6a9-fcda-4b61-a62e-7bd6f56cdf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:09.463691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:09.524692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1294/2626] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:09.535911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515b222-10a3-40b7-a2e4-f44ed6ef7b16 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:09.537617 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7515b222-10a3-40b7-a2e4-f44ed6ef7b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:09.594945 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7515b222-10a3-40b7-a2e4-f44ed6ef7b16 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:09.598569 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbb896-9d8e-48fa-93e3-99b00736f1cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:09.599232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb896-9d8e-48fa-93e3-99b00736f1cd service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:09.599517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb896-9d8e-48fa-93e3-99b00736f1cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:09.599793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbb896-9d8e-48fa-93e3-99b00736f1cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:09.609227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbb896-9d8e-48fa-93e3-99b00736f1cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:09.610665 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecbb896-9d8e-48fa-93e3-99b00736f1cd service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:09.620736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1333/2627] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:09.716115 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5b6a9-fcda-4b61-a62e-7bd6f56cdf7d None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:09.717520 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-cbf5b6a9-fcda-4b61-a62e-7bd6f56cdf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:09.730002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5b6a9-fcda-4b61-a62e-7bd6f56cdf7d None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:09.733576 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f48b240-0446-4ab9-a57e-12ac673b9d60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:09.734209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48b240-0446-4ab9-a57e-12ac673b9d60 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:09.734490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48b240-0446-4ab9-a57e-12ac673b9d60 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:09.734764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f48b240-0446-4ab9-a57e-12ac673b9d60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:09.790733 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48b240-0446-4ab9-a57e-12ac673b9d60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:09.792844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f48b240-0446-4ab9-a57e-12ac673b9d60 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:09.801612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1295/2628] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:12.640050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbb896-9d8e-48fa-93e3-99b00736f1cd service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:12.687736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:12.704124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbb896-9d8e-48fa-93e3-99b00736f1cd service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:12.708685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:12.709556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:12.709840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:12.710124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] PATH_INFO: `/v3/users/2063d7c061c347f29dd18fe2b4e545b5` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:12.711345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2063d7c061c347f29dd18fe2b4e545b5)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:12.713293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:12.762245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2063d7c061c347f29dd18fe2b4e545b5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:12.762942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2063d7c061c347f29dd18fe2b4e545b5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:12.763567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2063d7c061c347f29dd18fe2b4e545b5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:12.770310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2063d7c061c347f29dd18fe2b4e545b5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:12.777699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2063d7c061c347f29dd18fe2b4e545b5'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:12.796510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1334/2629] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:12 2022] DELETE /identity/v3/users/2063d7c061c347f29dd18fe2b4e545b5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:12.801232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e015ab-2132-4384-985f-a57502ff7c19 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:12.801701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e015ab-2132-4384-985f-a57502ff7c19 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:12.801846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e015ab-2132-4384-985f-a57502ff7c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:12.820995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-13e015ab-2132-4384-985f-a57502ff7c19 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:12.822227 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-13e015ab-2132-4384-985f-a57502ff7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:12.881218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1296/2630] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:12.891485 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:12.892878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:12.951394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4f443-f657-4e5b-a533-f22568f4344c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:12.955040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed1f71-5b02-493d-823f-b293debe47c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:12.955691 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed1f71-5b02-493d-823f-b293debe47c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:12.955976 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed1f71-5b02-493d-823f-b293debe47c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:12.956256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed1f71-5b02-493d-823f-b293debe47c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:12.965914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed1f71-5b02-493d-823f-b293debe47c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:12.967397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ed1f71-5b02-493d-823f-b293debe47c2 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:12.976848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1335/2631] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:13.250513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e015ab-2132-4384-985f-a57502ff7c19 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:13.252012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-13e015ab-2132-4384-985f-a57502ff7c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:13.264155 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e015ab-2132-4384-985f-a57502ff7c19 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:13.269280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:13.270144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:13.270425 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:13.270700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] PATH_INFO: `/v3/projects/66347fccdbc7486fb933ed5950fd1b82` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:13.272590 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66347fccdbc7486fb933ed5950fd1b82)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:13.275278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:13.317268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:13.324294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66347fccdbc7486fb933ed5950fd1b82', 'request_id': 'req-bb4d656a-4056-4da9-b22e-d673490990b2'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.331826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66347fccdbc7486fb933ed5950fd1b82', 'request_id': 'req-bb4d656a-4056-4da9-b22e-d673490990b2'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.337488 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66347fccdbc7486fb933ed5950fd1b82', 'request_id': 'req-bb4d656a-4056-4da9-b22e-d673490990b2'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.348252 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] The token cache is being invalidate because project 66347fccdbc7486fb933ed5950fd1b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:13.348537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.349171 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.350693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1297/2632] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:13 2022] DELETE /identity/v3/projects/66347fccdbc7486fb933ed5950fd1b82 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:13.355167 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed1f71-5b02-493d-823f-b293debe47c2 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:13.364674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ed1f71-5b02-493d-823f-b293debe47c2 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:13.420687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:13.421544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:13.421823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:13.422096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] PATH_INFO: `/v3/users/3e63d009dbc144ba80c931dfe7b28b21` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:13.423290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e63d009dbc144ba80c931dfe7b28b21)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:13.425222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:13.435960 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:13.470589 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e63d009dbc144ba80c931dfe7b28b21'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.471269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e63d009dbc144ba80c931dfe7b28b21'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.471870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e63d009dbc144ba80c931dfe7b28b21'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.478565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e63d009dbc144ba80c931dfe7b28b21'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.485912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e63d009dbc144ba80c931dfe7b28b21'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.503293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1336/2633] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:13 2022] DELETE /identity/v3/users/3e63d009dbc144ba80c931dfe7b28b21 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:13.777286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:13.778874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:13.794971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4d656a-4056-4da9-b22e-d673490990b2 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:13.852569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:13.853354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:13.853637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:13.853912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] PATH_INFO: `/v3/projects/1be91753d6b445a099a038dd78432224` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:13.855725 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1be91753d6b445a099a038dd78432224)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:13.857685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:13.902650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1be91753d6b445a099a038dd78432224', 'request_id': 'req-2a1b8f06-3cbe-4513-9189-79304a1f4230'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.910185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1be91753d6b445a099a038dd78432224', 'request_id': 'req-2a1b8f06-3cbe-4513-9189-79304a1f4230'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.915740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1be91753d6b445a099a038dd78432224', 'request_id': 'req-2a1b8f06-3cbe-4513-9189-79304a1f4230'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.927477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] The token cache is being invalidate because project 1be91753d6b445a099a038dd78432224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:13.927762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.928388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:13.929955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1298/2634] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:13 2022] DELETE /identity/v3/projects/1be91753d6b445a099a038dd78432224 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:13.934266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:13.935776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:13.948988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa0d90-dfb7-4e01-9583-834acd349678 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:14.005473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:14.006343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:14.006621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:14.006892 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] PATH_INFO: `/v3/users/7f2e289c2d5341e092e0ef48eca59815` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:14.008087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f2e289c2d5341e092e0ef48eca59815)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:14.010017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:14.056450 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f2e289c2d5341e092e0ef48eca59815'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:14.057092 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f2e289c2d5341e092e0ef48eca59815'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:14.057715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f2e289c2d5341e092e0ef48eca59815'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:14.064480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f2e289c2d5341e092e0ef48eca59815'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:14.071415 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-ecd6c1b3-68fd-419a-b623-c29ad5a46350 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f2e289c2d5341e092e0ef48eca59815'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:14.088961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1337/2635] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:13 2022] DELETE /identity/v3/users/7f2e289c2d5341e092e0ef48eca59815 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:27:14.445682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:14.447347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:14.463700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b8f06-3cbe-4513-9189-79304a1f4230 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:14.530657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:14.531855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:14.532182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:14.533039 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] PATH_INFO: `/v3/projects/ce69e4e8fc3943b0a70d77956dd31b9a` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:14.534541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce69e4e8fc3943b0a70d77956dd31b9a)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:14.536637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:14.538159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:14.588003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce69e4e8fc3943b0a70d77956dd31b9a', 'request_id': 'req-9a702852-14f8-4eff-bd95-41e6b0a17d1d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:14.596228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce69e4e8fc3943b0a70d77956dd31b9a', 'request_id': 'req-9a702852-14f8-4eff-bd95-41e6b0a17d1d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:14.602342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce69e4e8fc3943b0a70d77956dd31b9a', 'request_id': 'req-9a702852-14f8-4eff-bd95-41e6b0a17d1d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:14.613633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] The token cache is being invalidate because project ce69e4e8fc3943b0a70d77956dd31b9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:14.613921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:14.614597 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-9a702852-14f8-4eff-bd95-41e6b0a17d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:14.616280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1299/2636] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:14 2022] DELETE /identity/v3/projects/ce69e4e8fc3943b0a70d77956dd31b9a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:14.623309 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152539-8559-4248-8537-a76ef73d7ba1 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:14.623533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152539-8559-4248-8537-a76ef73d7ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:14.623814 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4152539-8559-4248-8537-a76ef73d7ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:14.636612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:14.643517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e4152539-8559-4248-8537-a76ef73d7ba1 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:14.645538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e4152539-8559-4248-8537-a76ef73d7ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:14.707228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1338/2637] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:14.716081 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d5c44-6fda-45c3-9923-ab5b7beeb1f6 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:14.716371 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d5c44-6fda-45c3-9923-ab5b7beeb1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:14.716650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d5c44-6fda-45c3-9923-ab5b7beeb1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:14.735758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-fd5d5c44-6fda-45c3-9923-ab5b7beeb1f6 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:14.736999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fd5d5c44-6fda-45c3-9923-ab5b7beeb1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:14.745803 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1300/2638] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:14.749830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152539-8559-4248-8537-a76ef73d7ba1 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:14.759677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4152539-8559-4248-8537-a76ef73d7ba1 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:14.764690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2a397-ed77-4bb9-9bba-c72197cefaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:14.765341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2a397-ed77-4bb9-9bba-c72197cefaba admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:14.765622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2a397-ed77-4bb9-9bba-c72197cefaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:14.765899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c2a397-ed77-4bb9-9bba-c72197cefaba admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:14.766621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2a397-ed77-4bb9-9bba-c72197cefaba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:27:14.766927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2a397-ed77-4bb9-9bba-c72197cefaba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:14.768570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c2a397-ed77-4bb9-9bba-c72197cefaba admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:14.781150 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1339/2639] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:27:14.785511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d5c44-6fda-45c3-9923-ab5b7beeb1f6 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:14.795399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d5c44-6fda-45c3-9923-ab5b7beeb1f6 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:14.800090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf78fab-084e-4043-9893-a4361cbff3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:14.800747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf78fab-084e-4043-9893-a4361cbff3dd admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:14.801035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf78fab-084e-4043-9893-a4361cbff3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:14.801314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf78fab-084e-4043-9893-a4361cbff3dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:14.802024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf78fab-084e-4043-9893-a4361cbff3dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:14.803988 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf78fab-084e-4043-9893-a4361cbff3dd admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:14.830982 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1301/2640] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:27:14 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:14.834620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2a397-ed77-4bb9-9bba-c72197cefaba admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:14.844921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c2a397-ed77-4bb9-9bba-c72197cefaba admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:14.900522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6877581-8e3d-45ac-89ce-8c5b947e8291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:14.901112 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6877581-8e3d-45ac-89ce-8c5b947e8291 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:14.901435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6877581-8e3d-45ac-89ce-8c5b947e8291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:14.901883 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6877581-8e3d-45ac-89ce-8c5b947e8291 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:14.902573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6877581-8e3d-45ac-89ce-8c5b947e8291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:14.904520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6877581-8e3d-45ac-89ce-8c5b947e8291 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:14.924527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1340/2641] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:27:14 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:14.928623 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf78fab-084e-4043-9893-a4361cbff3dd admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:14.939706 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf78fab-084e-4043-9893-a4361cbff3dd admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:14.944307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb440aa-ea8e-4176-a2df-a7156294cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:14.944961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb440aa-ea8e-4176-a2df-a7156294cd17 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:14.945244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb440aa-ea8e-4176-a2df-a7156294cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:14.945522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb440aa-ea8e-4176-a2df-a7156294cd17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:14.946240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb440aa-ea8e-4176-a2df-a7156294cd17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:14.947866 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb440aa-ea8e-4176-a2df-a7156294cd17 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:14.958185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1302/2642] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:14.962079 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6877581-8e3d-45ac-89ce-8c5b947e8291 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:14.972116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6877581-8e3d-45ac-89ce-8c5b947e8291 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:14.976637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f7d46-aa61-4185-9904-c61e19415553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:14.977276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f7d46-aa61-4185-9904-c61e19415553 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:14.977557 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f7d46-aa61-4185-9904-c61e19415553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:14.977829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f7d46-aa61-4185-9904-c61e19415553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:14.978551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f7d46-aa61-4185-9904-c61e19415553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:14.980930 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f7d46-aa61-4185-9904-c61e19415553 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:14.993833 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1341/2643] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:14.998050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb440aa-ea8e-4176-a2df-a7156294cd17 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:15.007905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb440aa-ea8e-4176-a2df-a7156294cd17 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:15.013059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e9572-218c-4127-b278-3f330c950f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:15.013927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e9572-218c-4127-b278-3f330c950f17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:15.014207 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e9572-218c-4127-b278-3f330c950f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:15.014506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02e9572-218c-4127-b278-3f330c950f17 admin admin] PATH_INFO: `/v3/projects/47afda3c7e2248109fce531c9fa0daeb/users/55b9f6657d8d4f2289062dae20a232f0/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:15.029514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e9572-218c-4127-b278-3f330c950f17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47afda3c7e2248109fce531c9fa0daeb, user_id=55b9f6657d8d4f2289062dae20a232f0, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:15.032210 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02e9572-218c-4127-b278-3f330c950f17 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:15.045187 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1303/2644] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:14 2022] PUT /identity/v3/projects/47afda3c7e2248109fce531c9fa0daeb/users/55b9f6657d8d4f2289062dae20a232f0/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:15.050237 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5e23-0b04-4d07-9790-a646b2920062 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:15.050536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5e23-0b04-4d07-9790-a646b2920062 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:15.050820 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39c5e23-0b04-4d07-9790-a646b2920062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:15.068812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b39c5e23-0b04-4d07-9790-a646b2920062 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:15.070017 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b39c5e23-0b04-4d07-9790-a646b2920062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:15.128602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1342/2645] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:15.139339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e9572-218c-4127-b278-3f330c950f17 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:15.141070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b02e9572-218c-4127-b278-3f330c950f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:15.203343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02e9572-218c-4127-b278-3f330c950f17 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:15.207010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7df9d-8d81-48bd-9a47-1f859a9d27d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:15.207662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7df9d-8d81-48bd-9a47-1f859a9d27d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:15.207952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7df9d-8d81-48bd-9a47-1f859a9d27d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:15.208229 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac7df9d-8d81-48bd-9a47-1f859a9d27d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:15.217577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7df9d-8d81-48bd-9a47-1f859a9d27d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:15.219040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac7df9d-8d81-48bd-9a47-1f859a9d27d6 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:15.228477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1304/2646] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:15.862737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79b93f-3bee-4ad1-9aad-ec49e13ce343 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:15.863050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79b93f-3bee-4ad1-9aad-ec49e13ce343 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:15.863326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf79b93f-3bee-4ad1-9aad-ec49e13ce343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:15.887889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:15.891411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-cf79b93f-3bee-4ad1-9aad-ec49e13ce343 None None] MFA Rules not processed for user `55b9f6657d8d4f2289062dae20a232f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:15.893487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-cf79b93f-3bee-4ad1-9aad-ec49e13ce343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:15.963022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1343/2647] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:15.967959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7df9d-8d81-48bd-9a47-1f859a9d27d6 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:15.977980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac7df9d-8d81-48bd-9a47-1f859a9d27d6 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:15.984034 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3912e-5caa-472c-aaa3-40cff7082513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:15.985262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3912e-5caa-472c-aaa3-40cff7082513 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:15.985791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3912e-5caa-472c-aaa3-40cff7082513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:15.986012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3912e-5caa-472c-aaa3-40cff7082513 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:15.986825 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3912e-5caa-472c-aaa3-40cff7082513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:15.988932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3912e-5caa-472c-aaa3-40cff7082513 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:16.018819 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1305/2648] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:27:15 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:27:16.019978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79b93f-3bee-4ad1-9aad-ec49e13ce343 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:16.031395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf79b93f-3bee-4ad1-9aad-ec49e13ce343 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:16.089519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e086057-7283-4050-9d8b-708bb264c4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:16.090191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e086057-7283-4050-9d8b-708bb264c4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:16.090476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e086057-7283-4050-9d8b-708bb264c4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:16.090754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e086057-7283-4050-9d8b-708bb264c4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:16.091514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e086057-7283-4050-9d8b-708bb264c4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:16.093464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e086057-7283-4050-9d8b-708bb264c4e0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:16.114172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1344/2649] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:27:16 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:27:16.118191 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3912e-5caa-472c-aaa3-40cff7082513 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:16.129215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3912e-5caa-472c-aaa3-40cff7082513 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:16.134174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9100c07-a736-4986-afe5-faba8a5ed0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:16.134862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9100c07-a736-4986-afe5-faba8a5ed0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:16.135186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9100c07-a736-4986-afe5-faba8a5ed0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:16.135463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9100c07-a736-4986-afe5-faba8a5ed0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:16.137205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9100c07-a736-4986-afe5-faba8a5ed0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:16.138848 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9100c07-a736-4986-afe5-faba8a5ed0e1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:16.140177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:16.152170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1306/2650] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:16.156107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e086057-7283-4050-9d8b-708bb264c4e0 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:16.166236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e086057-7283-4050-9d8b-708bb264c4e0 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:16.172003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8c374-7588-4040-b4be-4ab7f22c705b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:16.172882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8c374-7588-4040-b4be-4ab7f22c705b admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:16.173195 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8c374-7588-4040-b4be-4ab7f22c705b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:16.173472 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8c374-7588-4040-b4be-4ab7f22c705b admin admin] PATH_INFO: `/v3/projects/7f512e88a0e44ff39d77baf4888cd41a/users/11432820c6c14b3bac4e94f9c1e76acb/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:16.190704 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8c374-7588-4040-b4be-4ab7f22c705b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f512e88a0e44ff39d77baf4888cd41a, user_id=11432820c6c14b3bac4e94f9c1e76acb, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:16.193447 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8c374-7588-4040-b4be-4ab7f22c705b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:16.206909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1345/2651] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:16 2022] PUT /identity/v3/projects/7f512e88a0e44ff39d77baf4888cd41a/users/11432820c6c14b3bac4e94f9c1e76acb/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:16.210898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9100c07-a736-4986-afe5-faba8a5ed0e1 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:16.221101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9100c07-a736-4986-afe5-faba8a5ed0e1 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:16.281934 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b411c4-93b7-40a0-a281-1a8b9ef4e899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:16.282770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b411c4-93b7-40a0-a281-1a8b9ef4e899 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:16.283092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b411c4-93b7-40a0-a281-1a8b9ef4e899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:16.283375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b411c4-93b7-40a0-a281-1a8b9ef4e899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:16.284445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b411c4-93b7-40a0-a281-1a8b9ef4e899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:16.286059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b411c4-93b7-40a0-a281-1a8b9ef4e899 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:16.298179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1307/2652] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:27:16.302342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8c374-7588-4040-b4be-4ab7f22c705b admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:16.314584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8c374-7588-4040-b4be-4ab7f22c705b admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:16.319357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2f43f2-3e6f-490e-b2e4-6dca8624e263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:16.320308 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f43f2-3e6f-490e-b2e4-6dca8624e263 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:16.320590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f43f2-3e6f-490e-b2e4-6dca8624e263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:16.320866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f43f2-3e6f-490e-b2e4-6dca8624e263 admin admin] PATH_INFO: `/v3/projects/7f512e88a0e44ff39d77baf4888cd41a/users/11432820c6c14b3bac4e94f9c1e76acb/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:16.322828 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f43f2-3e6f-490e-b2e4-6dca8624e263 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f512e88a0e44ff39d77baf4888cd41a, user_id=11432820c6c14b3bac4e94f9c1e76acb, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:16.326038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2f43f2-3e6f-490e-b2e4-6dca8624e263 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:16.336198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1346/2653] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:27:16 2022] PUT /identity/v3/projects/7f512e88a0e44ff39d77baf4888cd41a/users/11432820c6c14b3bac4e94f9c1e76acb/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:16.975366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fe415-eb48-4467-a29a-04767d567f39 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:16.975895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fe415-eb48-4467-a29a-04767d567f39 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:16.976023 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fe415-eb48-4467-a29a-04767d567f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:17.005465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-711fe415-eb48-4467-a29a-04767d567f39 None None] MFA Rules not processed for user `11432820c6c14b3bac4e94f9c1e76acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:17.006677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-711fe415-eb48-4467-a29a-04767d567f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:17.079632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1308/2654] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:16 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:27:17.090771 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30d0f5-4c4e-4e71-b56b-b8f71a4ac0bb None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:17.091357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30d0f5-4c4e-4e71-b56b-b8f71a4ac0bb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:17.091460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e30d0f5-4c4e-4e71-b56b-b8f71a4ac0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:17.109427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-7e30d0f5-4c4e-4e71-b56b-b8f71a4ac0bb None None] MFA Rules not processed for user `55b9f6657d8d4f2289062dae20a232f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:27:17.110650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7e30d0f5-4c4e-4e71-b56b-b8f71a4ac0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:17.163512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:17.171802 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1347/2655] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:27:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:27:17.185056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fe415-eb48-4467-a29a-04767d567f39 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:17.187151 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-711fe415-eb48-4467-a29a-04767d567f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:17.261930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fe415-eb48-4467-a29a-04767d567f39 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:17.267564 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2b005-1bbd-4de1-b271-6df71205f1a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:17.268218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2b005-1bbd-4de1-b271-6df71205f1a1 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:17.268499 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2b005-1bbd-4de1-b271-6df71205f1a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:17.268776 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2b005-1bbd-4de1-b271-6df71205f1a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:17.277454 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2b005-1bbd-4de1-b271-6df71205f1a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:17.279070 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2b005-1bbd-4de1-b271-6df71205f1a1 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:17.288134 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1309/2656] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:27.284173 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:30.300036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30d0f5-4c4e-4e71-b56b-b8f71a4ac0bb None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:30.301464 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7e30d0f5-4c4e-4e71-b56b-b8f71a4ac0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:30.358660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e30d0f5-4c4e-4e71-b56b-b8f71a4ac0bb None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:30.362265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee016e-dc93-4aa7-ac30-2a194b3925bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:30.362913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee016e-dc93-4aa7-ac30-2a194b3925bd service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:30.363234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee016e-dc93-4aa7-ac30-2a194b3925bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:30.363517 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee016e-dc93-4aa7-ac30-2a194b3925bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:30.372651 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee016e-dc93-4aa7-ac30-2a194b3925bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:30.374093 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee016e-dc93-4aa7-ac30-2a194b3925bd service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:30.383598 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1348/2657] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:30 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:27:40.379359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=26 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:49.782786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2b005-1bbd-4de1-b271-6df71205f1a1 service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:49.843993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2b005-1bbd-4de1-b271-6df71205f1a1 service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:49.848469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:49.849330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:49.849614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:49.849889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] PATH_INFO: `/v3/users/55b9f6657d8d4f2289062dae20a232f0` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:49.851112 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55b9f6657d8d4f2289062dae20a232f0)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:49.853235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:49.900131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55b9f6657d8d4f2289062dae20a232f0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:49.900762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55b9f6657d8d4f2289062dae20a232f0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:49.901359 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55b9f6657d8d4f2289062dae20a232f0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:49.908307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55b9f6657d8d4f2289062dae20a232f0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:49.915257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55b9f6657d8d4f2289062dae20a232f0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:49.933364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1310/2658] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:49 2022] DELETE /identity/v3/users/55b9f6657d8d4f2289062dae20a232f0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:50.111522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee016e-dc93-4aa7-ac30-2a194b3925bd service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:50.122659 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee016e-dc93-4aa7-ac30-2a194b3925bd service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:50.181432 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:50.182342 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:50.182631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:50.182913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] PATH_INFO: `/v3/projects/47afda3c7e2248109fce531c9fa0daeb` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:50.184147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] RBAC: Authorizing `identity:delete_project(project_id=47afda3c7e2248109fce531c9fa0daeb)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:50.186072 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:50.233184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47afda3c7e2248109fce531c9fa0daeb', 'request_id': 'req-8803b4fd-3a9e-4742-a5a2-f81f9028257d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.241192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47afda3c7e2248109fce531c9fa0daeb', 'request_id': 'req-8803b4fd-3a9e-4742-a5a2-f81f9028257d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.247542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47afda3c7e2248109fce531c9fa0daeb', 'request_id': 'req-8803b4fd-3a9e-4742-a5a2-f81f9028257d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.258343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] The token cache is being invalidate because project 47afda3c7e2248109fce531c9fa0daeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:50.258636 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.259851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.261402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1349/2659] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:50 2022] DELETE /identity/v3/projects/47afda3c7e2248109fce531c9fa0daeb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:50.265398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:50.266807 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:50.280722 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c46b0-3d91-4f00-84e1-f0c11e09a761 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:50.336858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:50.337855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:50.338286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:50.338572 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] PATH_INFO: `/v3/users/11432820c6c14b3bac4e94f9c1e76acb` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:50.339821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11432820c6c14b3bac4e94f9c1e76acb)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:50.341757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:50.362707 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:50.388237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11432820c6c14b3bac4e94f9c1e76acb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.388890 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11432820c6c14b3bac4e94f9c1e76acb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.389499 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11432820c6c14b3bac4e94f9c1e76acb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.396317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11432820c6c14b3bac4e94f9c1e76acb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.403678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11432820c6c14b3bac4e94f9c1e76acb'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.420823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1311/2660] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:27:50 2022] DELETE /identity/v3/users/11432820c6c14b3bac4e94f9c1e76acb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:50.592351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:50.593804 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:50.606873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803b4fd-3a9e-4742-a5a2-f81f9028257d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:50.665249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:50.666793 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:50.667120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:50.667401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] PATH_INFO: `/v3/projects/7f512e88a0e44ff39d77baf4888cd41a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:50.668588 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f512e88a0e44ff39d77baf4888cd41a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:50.670518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:50.705451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:27:50.718306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f512e88a0e44ff39d77baf4888cd41a', 'request_id': 'req-b0a425f1-e2ec-49a5-9927-58f3755673fc'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.725374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f512e88a0e44ff39d77baf4888cd41a', 'request_id': 'req-b0a425f1-e2ec-49a5-9927-58f3755673fc'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.731565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f512e88a0e44ff39d77baf4888cd41a', 'request_id': 'req-b0a425f1-e2ec-49a5-9927-58f3755673fc'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.742697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] The token cache is being invalidate because project 7f512e88a0e44ff39d77baf4888cd41a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:27:50.743015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.744302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:27:50.745921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1350/2661] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:27:50 2022] DELETE /identity/v3/projects/7f512e88a0e44ff39d77baf4888cd41a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:27:59.484150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:27:59.485634 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:59.543916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0449857a-7dfb-45b1-93f7-c8fd76291e10 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:27:59.591238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c685c-6c8a-414d-a54e-61160b154d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:27:59.591893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c685c-6c8a-414d-a54e-61160b154d40 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:27:59.592180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c685c-6c8a-414d-a54e-61160b154d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:27:59.592459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c685c-6c8a-414d-a54e-61160b154d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:27:59.594303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e21c685c-6c8a-414d-a54e-61160b154d40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:27:59.657376 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c685c-6c8a-414d-a54e-61160b154d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:27:59.658821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c685c-6c8a-414d-a54e-61160b154d40 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:27:59.668823 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1312/2662] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:00.739592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:02.952512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:02.956003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:02.970739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a425f1-e2ec-49a5-9927-58f3755673fc admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:02.978520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:02.979422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:02.979708 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:02.979996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] PATH_INFO: `/v3/users/1b6a94234c2d44da86811f825ec21f28` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:02.981207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b6a94234c2d44da86811f825ec21f28)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:02.983412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:03.033333 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b6a94234c2d44da86811f825ec21f28'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:03.034045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b6a94234c2d44da86811f825ec21f28'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:03.034676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b6a94234c2d44da86811f825ec21f28'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:03.043817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b6a94234c2d44da86811f825ec21f28'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:03.052500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-dc74454c-fdfa-4733-8c76-7f065956e55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b6a94234c2d44da86811f825ec21f28'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:03.075675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1351/2663] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:28:02 2022] DELETE /identity/v3/users/1b6a94234c2d44da86811f825ec21f28 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:03.259783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c685c-6c8a-414d-a54e-61160b154d40 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:03.266005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:03.276327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c685c-6c8a-414d-a54e-61160b154d40 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:03.335785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:03.337099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.337402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.337739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] PATH_INFO: `/v3/projects/ebfdd85c68a4421781e66ddbaea93e6b` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:03.338933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebfdd85c68a4421781e66ddbaea93e6b)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:03.340876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:03.386670 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebfdd85c68a4421781e66ddbaea93e6b', 'request_id': 'req-c9515780-dea6-4c29-ab89-e544439b1e59'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:03.393788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebfdd85c68a4421781e66ddbaea93e6b', 'request_id': 'req-c9515780-dea6-4c29-ab89-e544439b1e59'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:03.400265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebfdd85c68a4421781e66ddbaea93e6b', 'request_id': 'req-c9515780-dea6-4c29-ab89-e544439b1e59'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:03.411392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] The token cache is being invalidate because project ebfdd85c68a4421781e66ddbaea93e6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:28:03.411681 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:03.412311 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-c9515780-dea6-4c29-ab89-e544439b1e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:03.413836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1313/2664] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:28:03 2022] DELETE /identity/v3/projects/ebfdd85c68a4421781e66ddbaea93e6b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:03.418851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88f62-4b2e-4a46-a543-40916d6b2f95 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.419186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88f62-4b2e-4a46-a543-40916d6b2f95 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.419471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc88f62-4b2e-4a46-a543-40916d6b2f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:03.436755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-9cc88f62-4b2e-4a46-a543-40916d6b2f95 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:03.437958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9cc88f62-4b2e-4a46-a543-40916d6b2f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:03.498500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1352/2665] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:28:03.506382 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb994e0-2416-4304-9d06-ebdd7b5368cf None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.506679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb994e0-2416-4304-9d06-ebdd7b5368cf None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.506983 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb994e0-2416-4304-9d06-ebdd7b5368cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:03.525034 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-fbb994e0-2416-4304-9d06-ebdd7b5368cf None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:03.526247 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fbb994e0-2416-4304-9d06-ebdd7b5368cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:03.534403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1314/2666] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:03.538419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc88f62-4b2e-4a46-a543-40916d6b2f95 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:03.548656 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc88f62-4b2e-4a46-a543-40916d6b2f95 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:03.553198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af0c6-357e-4769-8789-ef9806c853bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:03.553848 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af0c6-357e-4769-8789-ef9806c853bd admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.554133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af0c6-357e-4769-8789-ef9806c853bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.554411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af0c6-357e-4769-8789-ef9806c853bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:03.555779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af0c6-357e-4769-8789-ef9806c853bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:28:03.556089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af0c6-357e-4769-8789-ef9806c853bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:03.557697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9af0c6-357e-4769-8789-ef9806c853bd admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:03.569015 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1353/2667] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:28:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:28:03.573365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb994e0-2416-4304-9d06-ebdd7b5368cf None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:03.582588 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb994e0-2416-4304-9d06-ebdd7b5368cf None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:03.587587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c4e1c-2f98-4245-a963-19bfc111e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:03.588237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4e1c-2f98-4245-a963-19bfc111e92a admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.588526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4e1c-2f98-4245-a963-19bfc111e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.588808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c4e1c-2f98-4245-a963-19bfc111e92a admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:03.589499 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c4e1c-2f98-4245-a963-19bfc111e92a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:03.591448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492c4e1c-2f98-4245-a963-19bfc111e92a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:03.618536 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1315/2668] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:28:03 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:03.622667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af0c6-357e-4769-8789-ef9806c853bd admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:03.632710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af0c6-357e-4769-8789-ef9806c853bd admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:03.691632 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2951d-22b0-4909-9e9c-08c8e1716bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:03.692305 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2951d-22b0-4909-9e9c-08c8e1716bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.692610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2951d-22b0-4909-9e9c-08c8e1716bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.692886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd2951d-22b0-4909-9e9c-08c8e1716bd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:03.693579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2951d-22b0-4909-9e9c-08c8e1716bd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:03.695668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd2951d-22b0-4909-9e9c-08c8e1716bd9 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:03.703879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:03.720777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1354/2669] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:28:03 2022] POST /identity/v3/users => generated 303 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:28:03.724908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c4e1c-2f98-4245-a963-19bfc111e92a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:03.735911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c4e1c-2f98-4245-a963-19bfc111e92a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:03.740812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522aaf6-cc08-4a2a-9a89-e99376fdfd8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:03.741467 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522aaf6-cc08-4a2a-9a89-e99376fdfd8d admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.741756 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522aaf6-cc08-4a2a-9a89-e99376fdfd8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.742036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0522aaf6-cc08-4a2a-9a89-e99376fdfd8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:03.743447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522aaf6-cc08-4a2a-9a89-e99376fdfd8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:03.745085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0522aaf6-cc08-4a2a-9a89-e99376fdfd8d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:03.755386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1316/2670] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:03.759795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2951d-22b0-4909-9e9c-08c8e1716bd9 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:03.769725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd2951d-22b0-4909-9e9c-08c8e1716bd9 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:03.775025 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afbff6-b0b1-4090-83d9-bf128d716199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:03.775676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbff6-b0b1-4090-83d9-bf128d716199 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.775958 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbff6-b0b1-4090-83d9-bf128d716199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.776261 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afbff6-b0b1-4090-83d9-bf128d716199 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:03.777010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbff6-b0b1-4090-83d9-bf128d716199 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:03.778606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70afbff6-b0b1-4090-83d9-bf128d716199 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:03.788696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1355/2671] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:28:03.793392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522aaf6-cc08-4a2a-9a89-e99376fdfd8d admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:03.803436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0522aaf6-cc08-4a2a-9a89-e99376fdfd8d admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:03.808442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b30b11-8639-4e2e-83e2-3548bb2d4fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:03.809314 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b30b11-8639-4e2e-83e2-3548bb2d4fe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.809605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b30b11-8639-4e2e-83e2-3548bb2d4fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.809889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b30b11-8639-4e2e-83e2-3548bb2d4fe0 admin admin] PATH_INFO: `/v3/projects/4db2aa20626e4b9caaa399e114054bb5/users/40a7f5fbc75e47f99c59f6122a16f4f1/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:03.824337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b30b11-8639-4e2e-83e2-3548bb2d4fe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db2aa20626e4b9caaa399e114054bb5, user_id=40a7f5fbc75e47f99c59f6122a16f4f1, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:03.827022 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b30b11-8639-4e2e-83e2-3548bb2d4fe0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:03.840090 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1317/2672] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:03 2022] PUT /identity/v3/projects/4db2aa20626e4b9caaa399e114054bb5/users/40a7f5fbc75e47f99c59f6122a16f4f1/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:03.844977 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ff71-cd05-488c-932a-64fa01875615 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.845284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ff71-cd05-488c-932a-64fa01875615 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.845565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b9ff71-cd05-488c-932a-64fa01875615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:03.863661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e5b9ff71-cd05-488c-932a-64fa01875615 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:03.864843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e5b9ff71-cd05-488c-932a-64fa01875615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:03.923303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1356/2673] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:03.933067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b30b11-8639-4e2e-83e2-3548bb2d4fe0 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:03.934741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b1b30b11-8639-4e2e-83e2-3548bb2d4fe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:03.969085 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:03.994402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b30b11-8639-4e2e-83e2-3548bb2d4fe0 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:03.998029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5749-ca3e-40ba-a6bd-eeed2bd29db7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:03.998671 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5749-ca3e-40ba-a6bd-eeed2bd29db7 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:03.998975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5749-ca3e-40ba-a6bd-eeed2bd29db7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:03.999255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e5749-ca3e-40ba-a6bd-eeed2bd29db7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:04.008476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e5749-ca3e-40ba-a6bd-eeed2bd29db7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:04.009915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e5749-ca3e-40ba-a6bd-eeed2bd29db7 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:04.019336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1318/2674] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:04.697797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b13668-f334-4cb4-9915-656fe186e7a7 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:04.698392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b13668-f334-4cb4-9915-656fe186e7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:04.698392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b13668-f334-4cb4-9915-656fe186e7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:04.725147 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-03b13668-f334-4cb4-9915-656fe186e7a7 None None] MFA Rules not processed for user `40a7f5fbc75e47f99c59f6122a16f4f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:04.726363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-03b13668-f334-4cb4-9915-656fe186e7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:04.795348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1357/2675] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:04 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:04.799936 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5749-ca3e-40ba-a6bd-eeed2bd29db7 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:04.810166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e5749-ca3e-40ba-a6bd-eeed2bd29db7 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:04.814937 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85941c24-1b54-4f60-a736-d8d58c01f893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:04.815612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85941c24-1b54-4f60-a736-d8d58c01f893 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:04.815897 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85941c24-1b54-4f60-a736-d8d58c01f893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:04.816174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85941c24-1b54-4f60-a736-d8d58c01f893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:04.816874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85941c24-1b54-4f60-a736-d8d58c01f893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:04.818785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85941c24-1b54-4f60-a736-d8d58c01f893 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:04.850145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1319/2676] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:28:04 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:04.851359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b13668-f334-4cb4-9915-656fe186e7a7 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:04.862574 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b13668-f334-4cb4-9915-656fe186e7a7 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:04.921790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9302eb1-6409-47f0-9707-b0f7939e65b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:04.922455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9302eb1-6409-47f0-9707-b0f7939e65b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:04.922736 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9302eb1-6409-47f0-9707-b0f7939e65b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:04.923048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9302eb1-6409-47f0-9707-b0f7939e65b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:04.923719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9302eb1-6409-47f0-9707-b0f7939e65b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:04.925625 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9302eb1-6409-47f0-9707-b0f7939e65b3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:04.940743 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:04.947559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1358/2677] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:28:04 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:04.951456 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85941c24-1b54-4f60-a736-d8d58c01f893 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:04.961569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85941c24-1b54-4f60-a736-d8d58c01f893 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:04.966074 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9ac46-444e-46a5-abb3-1c7cc3684317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:04.966724 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9ac46-444e-46a5-abb3-1c7cc3684317 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:04.967040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9ac46-444e-46a5-abb3-1c7cc3684317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:04.967317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9ac46-444e-46a5-abb3-1c7cc3684317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:04.968057 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9ac46-444e-46a5-abb3-1c7cc3684317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:04.969663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9ac46-444e-46a5-abb3-1c7cc3684317 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:04.981537 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1320/2678] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:04.985808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9302eb1-6409-47f0-9707-b0f7939e65b3 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:04.996613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9302eb1-6409-47f0-9707-b0f7939e65b3 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:05.001161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac542fb-7ebf-4fa4-a3c3-a835dbe18535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:05.002059 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac542fb-7ebf-4fa4-a3c3-a835dbe18535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:05.002340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac542fb-7ebf-4fa4-a3c3-a835dbe18535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:05.002609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac542fb-7ebf-4fa4-a3c3-a835dbe18535 admin admin] PATH_INFO: `/v3/projects/7e51a3a7949e4316bb53f1557bc43bb9/users/8aa6134a023e4f04a41c20d8f3513073/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:05.017829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac542fb-7ebf-4fa4-a3c3-a835dbe18535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e51a3a7949e4316bb53f1557bc43bb9, user_id=8aa6134a023e4f04a41c20d8f3513073, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:05.020550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac542fb-7ebf-4fa4-a3c3-a835dbe18535 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:05.033203 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1359/2679] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:04 2022] PUT /identity/v3/projects/7e51a3a7949e4316bb53f1557bc43bb9/users/8aa6134a023e4f04a41c20d8f3513073/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:05.037222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9ac46-444e-46a5-abb3-1c7cc3684317 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:05.048455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9ac46-444e-46a5-abb3-1c7cc3684317 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:05.104113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e23baa-e93e-4cae-b2a9-032a8467d82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:05.104772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e23baa-e93e-4cae-b2a9-032a8467d82d admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:05.105054 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e23baa-e93e-4cae-b2a9-032a8467d82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:05.105325 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e23baa-e93e-4cae-b2a9-032a8467d82d admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:05.106035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e23baa-e93e-4cae-b2a9-032a8467d82d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:05.107658 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e23baa-e93e-4cae-b2a9-032a8467d82d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:05.117104 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1321/2680] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:05.121919 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac542fb-7ebf-4fa4-a3c3-a835dbe18535 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:05.132735 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac542fb-7ebf-4fa4-a3c3-a835dbe18535 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:05.138297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a1903-de3e-4657-9721-a5d6fcc4750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:05.139351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a1903-de3e-4657-9721-a5d6fcc4750c admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:05.139661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a1903-de3e-4657-9721-a5d6fcc4750c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:05.139937 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a1903-de3e-4657-9721-a5d6fcc4750c admin admin] PATH_INFO: `/v3/projects/7e51a3a7949e4316bb53f1557bc43bb9/users/8aa6134a023e4f04a41c20d8f3513073/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:05.142001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a1903-de3e-4657-9721-a5d6fcc4750c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e51a3a7949e4316bb53f1557bc43bb9, user_id=8aa6134a023e4f04a41c20d8f3513073, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:05.144705 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a1903-de3e-4657-9721-a5d6fcc4750c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:05.156048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1360/2681] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:05 2022] PUT /identity/v3/projects/7e51a3a7949e4316bb53f1557bc43bb9/users/8aa6134a023e4f04a41c20d8f3513073/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:05.815710 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc089d4-8d75-49ed-b728-c9d9c5ce691e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:05.816193 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc089d4-8d75-49ed-b728-c9d9c5ce691e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:05.816305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc089d4-8d75-49ed-b728-c9d9c5ce691e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:05.844604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-fcc089d4-8d75-49ed-b728-c9d9c5ce691e None None] MFA Rules not processed for user `8aa6134a023e4f04a41c20d8f3513073`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:05.845860 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fcc089d4-8d75-49ed-b728-c9d9c5ce691e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:05.917206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1322/2682] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:05 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:06.943968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a1903-de3e-4657-9721-a5d6fcc4750c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:07.011813 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a1903-de3e-4657-9721-a5d6fcc4750c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:07.016463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:07.017412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:07.017696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:07.017972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] PATH_INFO: `/v3/users/40a7f5fbc75e47f99c59f6122a16f4f1` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:07.019371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a7f5fbc75e47f99c59f6122a16f4f1)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:07.021807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:07.066840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a7f5fbc75e47f99c59f6122a16f4f1'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.067461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a7f5fbc75e47f99c59f6122a16f4f1'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.068062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a7f5fbc75e47f99c59f6122a16f4f1'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.075437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a7f5fbc75e47f99c59f6122a16f4f1'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.082479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a7f5fbc75e47f99c59f6122a16f4f1'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.099798 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1361/2683] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:28:06 2022] DELETE /identity/v3/users/40a7f5fbc75e47f99c59f6122a16f4f1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:07.272236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc089d4-8d75-49ed-b728-c9d9c5ce691e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:07.283398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc089d4-8d75-49ed-b728-c9d9c5ce691e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:07.309468 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:07.347348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:07.348128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:07.348414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:07.348696 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] PATH_INFO: `/v3/projects/4db2aa20626e4b9caaa399e114054bb5` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:07.349887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db2aa20626e4b9caaa399e114054bb5)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:07.352532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:07.397909 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db2aa20626e4b9caaa399e114054bb5', 'request_id': 'req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.409053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db2aa20626e4b9caaa399e114054bb5', 'request_id': 'req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.417543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db2aa20626e4b9caaa399e114054bb5', 'request_id': 'req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.429149 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] The token cache is being invalidate because project 4db2aa20626e4b9caaa399e114054bb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:28:07.429438 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.430734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.432300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1323/2684] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:28:07 2022] DELETE /identity/v3/projects/4db2aa20626e4b9caaa399e114054bb5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:07.436271 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:07.437701 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:07.451066 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e24c9b-8ffd-4fa1-8c57-9ff2134fd98a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:07.489312 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:07.511240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:07.512128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:07.512411 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:07.512690 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] PATH_INFO: `/v3/users/8aa6134a023e4f04a41c20d8f3513073` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:07.513897 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aa6134a023e4f04a41c20d8f3513073)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:07.515878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:07.561479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aa6134a023e4f04a41c20d8f3513073'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.562116 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aa6134a023e4f04a41c20d8f3513073'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.562708 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aa6134a023e4f04a41c20d8f3513073'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.569528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aa6134a023e4f04a41c20d8f3513073'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.576931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-ec05fd86-5311-44c2-9b15-4d0ac695107d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aa6134a023e4f04a41c20d8f3513073'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.594824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1362/2685] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:28:07 2022] DELETE /identity/v3/users/8aa6134a023e4f04a41c20d8f3513073 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:07.768035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:07.769555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:07.794258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04521f43-6746-4a8c-b58a-3fe5b0e5aa30 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:07.854078 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:07.854852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:07.855161 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:07.855432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] PATH_INFO: `/v3/projects/7e51a3a7949e4316bb53f1557bc43bb9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:07.856616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e51a3a7949e4316bb53f1557bc43bb9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:07.858567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:07.907032 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e51a3a7949e4316bb53f1557bc43bb9', 'request_id': 'req-805d0c19-01be-4dde-819d-9cdffebd77b9'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.910550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:07.917339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e51a3a7949e4316bb53f1557bc43bb9', 'request_id': 'req-805d0c19-01be-4dde-819d-9cdffebd77b9'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.928549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e51a3a7949e4316bb53f1557bc43bb9', 'request_id': 'req-805d0c19-01be-4dde-819d-9cdffebd77b9'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.939821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] The token cache is being invalidate because project 7e51a3a7949e4316bb53f1557bc43bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:28:07.940106 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.940757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-805d0c19-01be-4dde-819d-9cdffebd77b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:07.942284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1324/2686] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:28:07 2022] DELETE /identity/v3/projects/7e51a3a7949e4316bb53f1557bc43bb9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:07.948161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d19b9d-f9c0-4b52-b8e6-e1c25b408faa None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:07.948622 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d19b9d-f9c0-4b52-b8e6-e1c25b408faa None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:07.948779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d19b9d-f9c0-4b52-b8e6-e1c25b408faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:07.966343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-97d19b9d-f9c0-4b52-b8e6-e1c25b408faa None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:07.967577 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-97d19b9d-f9c0-4b52-b8e6-e1c25b408faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:08.028069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1363/2687] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:08.036170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92280f4a-2358-47d5-8c2b-e415d5962607 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.036501 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92280f4a-2358-47d5-8c2b-e415d5962607 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.036833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92280f4a-2358-47d5-8c2b-e415d5962607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.056272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-92280f4a-2358-47d5-8c2b-e415d5962607 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:08.057467 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-92280f4a-2358-47d5-8c2b-e415d5962607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:08.065313 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1325/2688] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:08.069374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d19b9d-f9c0-4b52-b8e6-e1c25b408faa None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.078818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d19b9d-f9c0-4b52-b8e6-e1c25b408faa None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.083343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7c228-455d-4409-aab4-7855e0b9d312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.083984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7c228-455d-4409-aab4-7855e0b9d312 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.084266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7c228-455d-4409-aab4-7855e0b9d312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.084539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7c228-455d-4409-aab4-7855e0b9d312 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.085254 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7c228-455d-4409-aab4-7855e0b9d312 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:28:08.085561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7c228-455d-4409-aab4-7855e0b9d312 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.087220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7c228-455d-4409-aab4-7855e0b9d312 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.098459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1364/2689] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:28:08.103231 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92280f4a-2358-47d5-8c2b-e415d5962607 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.112340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92280f4a-2358-47d5-8c2b-e415d5962607 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.116884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108debe-6025-48cb-8e82-446857a473ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.118065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108debe-6025-48cb-8e82-446857a473ae admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.118342 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108debe-6025-48cb-8e82-446857a473ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.118614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108debe-6025-48cb-8e82-446857a473ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.119347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108debe-6025-48cb-8e82-446857a473ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.121234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0108debe-6025-48cb-8e82-446857a473ae admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.155046 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1326/2690] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:28:08 2022] POST /identity/v3/projects => generated 379 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:08.159168 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7c228-455d-4409-aab4-7855e0b9d312 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.169631 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7c228-455d-4409-aab4-7855e0b9d312 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.215491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:08.230141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a286f-7ab6-4bba-9a38-05a69eaff66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.230817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a286f-7ab6-4bba-9a38-05a69eaff66c admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.231144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a286f-7ab6-4bba-9a38-05a69eaff66c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.231458 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542a286f-7ab6-4bba-9a38-05a69eaff66c admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.232146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a286f-7ab6-4bba-9a38-05a69eaff66c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.234102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542a286f-7ab6-4bba-9a38-05a69eaff66c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.253740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1365/2691] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:28:08 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:08.258012 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108debe-6025-48cb-8e82-446857a473ae admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.268286 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0108debe-6025-48cb-8e82-446857a473ae admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.273027 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddf87c-865d-4c85-af09-a4d1c05b3d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.274205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf87c-865d-4c85-af09-a4d1c05b3d94 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.274493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf87c-865d-4c85-af09-a4d1c05b3d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.274772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddf87c-865d-4c85-af09-a4d1c05b3d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.275562 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddf87c-865d-4c85-af09-a4d1c05b3d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.277205 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddf87c-865d-4c85-af09-a4d1c05b3d94 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.287568 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1327/2692] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:08.292772 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a286f-7ab6-4bba-9a38-05a69eaff66c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.305922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542a286f-7ab6-4bba-9a38-05a69eaff66c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.312554 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4310f94-611b-43bd-b4b9-42cefc89d301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.313532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310f94-611b-43bd-b4b9-42cefc89d301 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.313960 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310f94-611b-43bd-b4b9-42cefc89d301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.314384 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4310f94-611b-43bd-b4b9-42cefc89d301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.315558 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4310f94-611b-43bd-b4b9-42cefc89d301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.318130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4310f94-611b-43bd-b4b9-42cefc89d301 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.332593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1366/2693] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:08.337199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddf87c-865d-4c85-af09-a4d1c05b3d94 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.347239 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddf87c-865d-4c85-af09-a4d1c05b3d94 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.352630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93f8be-aec1-4f34-9192-0ff60662ed92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.353509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93f8be-aec1-4f34-9192-0ff60662ed92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.353796 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93f8be-aec1-4f34-9192-0ff60662ed92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.354076 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93f8be-aec1-4f34-9192-0ff60662ed92 admin admin] PATH_INFO: `/v3/projects/1c81b64802f54c608c23b3cb43a1dd34/users/c94bdc19c35446fda7e73c18adbe576a/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.368689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93f8be-aec1-4f34-9192-0ff60662ed92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c81b64802f54c608c23b3cb43a1dd34, user_id=c94bdc19c35446fda7e73c18adbe576a, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.371345 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93f8be-aec1-4f34-9192-0ff60662ed92 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.384174 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1328/2694] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:08 2022] PUT /identity/v3/projects/1c81b64802f54c608c23b3cb43a1dd34/users/c94bdc19c35446fda7e73c18adbe576a/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:08.395538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fce339-d76a-429b-8e41-d76c9c2855f3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.395854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fce339-d76a-429b-8e41-d76c9c2855f3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.396134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fce339-d76a-429b-8e41-d76c9c2855f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.423400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-30fce339-d76a-429b-8e41-d76c9c2855f3 None None] MFA Rules not processed for user `c94bdc19c35446fda7e73c18adbe576a`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:08.424609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-30fce339-d76a-429b-8e41-d76c9c2855f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:08.488853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1367/2695] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:08.493277 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93f8be-aec1-4f34-9192-0ff60662ed92 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.553704 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93f8be-aec1-4f34-9192-0ff60662ed92 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.558786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7bb7e-af37-46c5-96af-56a513e57140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.559494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7bb7e-af37-46c5-96af-56a513e57140 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.559779 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7bb7e-af37-46c5-96af-56a513e57140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.560061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a7bb7e-af37-46c5-96af-56a513e57140 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.560746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7bb7e-af37-46c5-96af-56a513e57140 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.562685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a7bb7e-af37-46c5-96af-56a513e57140 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.587087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1329/2696] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:28:08 2022] POST /identity/v3/projects => generated 381 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:08.591117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fce339-d76a-429b-8e41-d76c9c2855f3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.602385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fce339-d76a-429b-8e41-d76c9c2855f3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.659621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca2794-2ca5-4f0a-ab12-4da5ba1399a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.660182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2794-2ca5-4f0a-ab12-4da5ba1399a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.660466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2794-2ca5-4f0a-ab12-4da5ba1399a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.660744 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca2794-2ca5-4f0a-ab12-4da5ba1399a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.661439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca2794-2ca5-4f0a-ab12-4da5ba1399a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.663401 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca2794-2ca5-4f0a-ab12-4da5ba1399a5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.683628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1368/2697] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:28:08 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:28:08.687991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7bb7e-af37-46c5-96af-56a513e57140 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.698769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a7bb7e-af37-46c5-96af-56a513e57140 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.703812 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e916428-0994-4f41-8e63-77155ccc6ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.704408 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e916428-0994-4f41-8e63-77155ccc6ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.704693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e916428-0994-4f41-8e63-77155ccc6ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.704973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e916428-0994-4f41-8e63-77155ccc6ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.705701 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e916428-0994-4f41-8e63-77155ccc6ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.707370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e916428-0994-4f41-8e63-77155ccc6ecb admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.719838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1330/2698] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:08.724036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca2794-2ca5-4f0a-ab12-4da5ba1399a5 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.734242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca2794-2ca5-4f0a-ab12-4da5ba1399a5 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.738873 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e9589-0994-46c7-9619-da98cc45094a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.739787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e9589-0994-46c7-9619-da98cc45094a admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.740075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e9589-0994-46c7-9619-da98cc45094a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.740360 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066e9589-0994-46c7-9619-da98cc45094a admin admin] PATH_INFO: `/v3/projects/7b2b176ec8334020933465531d8d9c8a/users/2529825ec4ef43d8a9db1bb86eaa748c/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.755080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e9589-0994-46c7-9619-da98cc45094a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2b176ec8334020933465531d8d9c8a, user_id=2529825ec4ef43d8a9db1bb86eaa748c, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.758381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066e9589-0994-46c7-9619-da98cc45094a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.771983 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1369/2699] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:08 2022] PUT /identity/v3/projects/7b2b176ec8334020933465531d8d9c8a/users/2529825ec4ef43d8a9db1bb86eaa748c/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:08.776380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e916428-0994-4f41-8e63-77155ccc6ecb admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.786507 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e916428-0994-4f41-8e63-77155ccc6ecb admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.828144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:08.844682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e684246-d91d-4eda-a692-72562718aaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.845344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e684246-d91d-4eda-a692-72562718aaa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.845632 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e684246-d91d-4eda-a692-72562718aaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.845911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e684246-d91d-4eda-a692-72562718aaa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.846630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e684246-d91d-4eda-a692-72562718aaa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.848259 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e684246-d91d-4eda-a692-72562718aaa0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.857999 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1331/2700] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:08.862269 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e9589-0994-46c7-9619-da98cc45094a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:08.872796 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066e9589-0994-46c7-9619-da98cc45094a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:08.877413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fc8d3-dc64-470e-bd1e-260868005ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:08.878295 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fc8d3-dc64-470e-bd1e-260868005ef6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.878580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fc8d3-dc64-470e-bd1e-260868005ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.878862 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fc8d3-dc64-470e-bd1e-260868005ef6 admin admin] PATH_INFO: `/v3/projects/7b2b176ec8334020933465531d8d9c8a/users/2529825ec4ef43d8a9db1bb86eaa748c/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.880938 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fc8d3-dc64-470e-bd1e-260868005ef6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2b176ec8334020933465531d8d9c8a, user_id=2529825ec4ef43d8a9db1bb86eaa748c, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:08.884287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fc8d3-dc64-470e-bd1e-260868005ef6 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:08.894328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1370/2701] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:08 2022] PUT /identity/v3/projects/7b2b176ec8334020933465531d8d9c8a/users/2529825ec4ef43d8a9db1bb86eaa748c/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:08.905468 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adadd5-2812-4092-8fcc-2954fec14715 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:08.905761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adadd5-2812-4092-8fcc-2954fec14715 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:08.906045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adadd5-2812-4092-8fcc-2954fec14715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:08.932142 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-f5adadd5-2812-4092-8fcc-2954fec14715 None None] MFA Rules not processed for user `2529825ec4ef43d8a9db1bb86eaa748c`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:08.933357 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f5adadd5-2812-4092-8fcc-2954fec14715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:09.004182 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1332/2702] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:28:09.015837 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fc8d3-dc64-470e-bd1e-260868005ef6 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:09.017606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a00fc8d3-dc64-470e-bd1e-260868005ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:09.028265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:09.080477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fc8d3-dc64-470e-bd1e-260868005ef6 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:09.084207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833306c-25a3-498b-b98f-16d9986252ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:09.084857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833306c-25a3-498b-b98f-16d9986252ec service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:09.085145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833306c-25a3-498b-b98f-16d9986252ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:09.085427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833306c-25a3-498b-b98f-16d9986252ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:09.095337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833306c-25a3-498b-b98f-16d9986252ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:09.096792 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833306c-25a3-498b-b98f-16d9986252ec service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:09.107675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1371/2703] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:09.179462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adadd5-2812-4092-8fcc-2954fec14715 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:09.189595 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5adadd5-2812-4092-8fcc-2954fec14715 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:09.193234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b504a5-45d1-4f5e-a03f-2308bd371168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:09.193874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b504a5-45d1-4f5e-a03f-2308bd371168 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:09.194156 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b504a5-45d1-4f5e-a03f-2308bd371168 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:09.194430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b504a5-45d1-4f5e-a03f-2308bd371168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:09.251101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b504a5-45d1-4f5e-a03f-2308bd371168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:09.252543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b504a5-45d1-4f5e-a03f-2308bd371168 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:09.261480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1333/2704] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:11.601827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833306c-25a3-498b-b98f-16d9986252ec service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:11.603412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2833306c-25a3-498b-b98f-16d9986252ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:11.661803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833306c-25a3-498b-b98f-16d9986252ec service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:11.665546 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e52be6-39f8-432c-bf4b-4c95b3d2cf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:11.666189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e52be6-39f8-432c-bf4b-4c95b3d2cf3b service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:11.666477 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e52be6-39f8-432c-bf4b-4c95b3d2cf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:11.666759 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e52be6-39f8-432c-bf4b-4c95b3d2cf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:11.668580 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-30e52be6-39f8-432c-bf4b-4c95b3d2cf3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:11.738754 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e52be6-39f8-432c-bf4b-4c95b3d2cf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:11.740245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e52be6-39f8-432c-bf4b-4c95b3d2cf3b service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:11.751338 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1372/2705] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:12.927538 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b504a5-45d1-4f5e-a03f-2308bd371168 service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:12.928969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-13b504a5-45d1-4f5e-a03f-2308bd371168 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:12.941555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b504a5-45d1-4f5e-a03f-2308bd371168 service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:12.945143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103eed06-c6fd-47a0-a303-947dff67e855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:12.946180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eed06-c6fd-47a0-a303-947dff67e855 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:12.946466 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eed06-c6fd-47a0-a303-947dff67e855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:12.946755 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103eed06-c6fd-47a0-a303-947dff67e855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:12.948512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-103eed06-c6fd-47a0-a303-947dff67e855 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:12.962620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eed06-c6fd-47a0-a303-947dff67e855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:12.964137 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103eed06-c6fd-47a0-a303-947dff67e855 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:12.980296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1334/2706] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:16.044438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e52be6-39f8-432c-bf4b-4c95b3d2cf3b service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:16.094565 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:16.106805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e52be6-39f8-432c-bf4b-4c95b3d2cf3b service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:16.111415 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:16.112280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:16.112564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:16.112838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] PATH_INFO: `/v3/users/c94bdc19c35446fda7e73c18adbe576a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:16.114027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94bdc19c35446fda7e73c18adbe576a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:16.116003 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:16.161570 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94bdc19c35446fda7e73c18adbe576a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.162138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94bdc19c35446fda7e73c18adbe576a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.162739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94bdc19c35446fda7e73c18adbe576a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.169452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94bdc19c35446fda7e73c18adbe576a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.177344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94bdc19c35446fda7e73c18adbe576a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.194561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1373/2707] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:28:16 2022] DELETE /identity/v3/users/c94bdc19c35446fda7e73c18adbe576a => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:16.199625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21edcba-d348-4fc5-84ff-0a92876c1b8f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:16.200122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21edcba-d348-4fc5-84ff-0a92876c1b8f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:16.200257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21edcba-d348-4fc5-84ff-0a92876c1b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:16.217830 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-a21edcba-d348-4fc5-84ff-0a92876c1b8f None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:16.219069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a21edcba-d348-4fc5-84ff-0a92876c1b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:16.262764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=100 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:16.277490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1335/2708] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:16.287383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:16.288881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:16.346284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d60c25-965b-4c57-9d86-f69f2c1423f0 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:16.349994 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724418-2b46-4356-8001-14e0a9930db3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:16.350639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724418-2b46-4356-8001-14e0a9930db3 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:16.350924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724418-2b46-4356-8001-14e0a9930db3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:16.351263 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724418-2b46-4356-8001-14e0a9930db3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:16.360233 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45724418-2b46-4356-8001-14e0a9930db3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:16.361679 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45724418-2b46-4356-8001-14e0a9930db3 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:16.371173 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1374/2709] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:16.637740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21edcba-d348-4fc5-84ff-0a92876c1b8f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:16.639266 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-a21edcba-d348-4fc5-84ff-0a92876c1b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:16.652236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21edcba-d348-4fc5-84ff-0a92876c1b8f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:16.657150 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:16.658088 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:16.658445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:16.658791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] PATH_INFO: `/v3/projects/1c81b64802f54c608c23b3cb43a1dd34` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:16.660529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c81b64802f54c608c23b3cb43a1dd34)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:16.662528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:16.709955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c81b64802f54c608c23b3cb43a1dd34', 'request_id': 'req-36995420-23ea-4416-85c2-3f2752ccd0ee'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.717665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c81b64802f54c608c23b3cb43a1dd34', 'request_id': 'req-36995420-23ea-4416-85c2-3f2752ccd0ee'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.723138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c81b64802f54c608c23b3cb43a1dd34', 'request_id': 'req-36995420-23ea-4416-85c2-3f2752ccd0ee'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.734766 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] The token cache is being invalidate because project 1c81b64802f54c608c23b3cb43a1dd34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:28:16.735084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.735705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.737222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1336/2710] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:28:16 2022] DELETE /identity/v3/projects/1c81b64802f54c608c23b3cb43a1dd34 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:16.741412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724418-2b46-4356-8001-14e0a9930db3 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:16.751022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724418-2b46-4356-8001-14e0a9930db3 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:16.808466 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:16.809340 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:16.809652 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:16.810050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] PATH_INFO: `/v3/users/2529825ec4ef43d8a9db1bb86eaa748c` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:16.811283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2529825ec4ef43d8a9db1bb86eaa748c)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:16.813217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:16.826799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:16.859620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2529825ec4ef43d8a9db1bb86eaa748c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.860263 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2529825ec4ef43d8a9db1bb86eaa748c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.860863 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2529825ec4ef43d8a9db1bb86eaa748c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.868005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2529825ec4ef43d8a9db1bb86eaa748c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.875251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-d291d4c4-6005-42ff-88aa-d167311e80cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2529825ec4ef43d8a9db1bb86eaa748c'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:16.893220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1375/2711] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:28:16 2022] DELETE /identity/v3/users/2529825ec4ef43d8a9db1bb86eaa748c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:17.170315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:17.172072 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:17.185491 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36995420-23ea-4416-85c2-3f2752ccd0ee admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:17.246638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:17.247451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.247734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.248035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] PATH_INFO: `/v3/projects/7b2b176ec8334020933465531d8d9c8a` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.249207 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2b176ec8334020933465531d8d9c8a)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:17.251145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:17.296779 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2b176ec8334020933465531d8d9c8a', 'request_id': 'req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:17.303761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2b176ec8334020933465531d8d9c8a', 'request_id': 'req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:17.309750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2b176ec8334020933465531d8d9c8a', 'request_id': 'req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:17.321260 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] The token cache is being invalidate because project 7b2b176ec8334020933465531d8d9c8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:28:17.321541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:17.322180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-5c7c0b03-a4d4-4987-ba9c-39dbc2cde5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:17.323735 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1337/2712] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:28:17 2022] DELETE /identity/v3/projects/7b2b176ec8334020933465531d8d9c8a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:17.328822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5820a-a657-41d7-a578-c349bfdf1f57 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.329284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5820a-a657-41d7-a578-c349bfdf1f57 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.329381 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5820a-a657-41d7-a578-c349bfdf1f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.348393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a7e5820a-a657-41d7-a578-c349bfdf1f57 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:17.349586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a7e5820a-a657-41d7-a578-c349bfdf1f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:17.412893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1376/2713] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:17.422138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e447-3501-48fc-b3a1-82a234f8a6a8 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.422433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e447-3501-48fc-b3a1-82a234f8a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.422715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e8e447-3501-48fc-b3a1-82a234f8a6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.430884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:17.443044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-91e8e447-3501-48fc-b3a1-82a234f8a6a8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:17.444262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-91e8e447-3501-48fc-b3a1-82a234f8a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:17.453310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1338/2714] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:17.457567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5820a-a657-41d7-a578-c349bfdf1f57 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:17.467671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5820a-a657-41d7-a578-c349bfdf1f57 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:17.472220 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc0a4a-5fe9-41e0-b23c-5a2db56451c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:17.472868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0a4a-5fe9-41e0-b23c-5a2db56451c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.473152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0a4a-5fe9-41e0-b23c-5a2db56451c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.473427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc0a4a-5fe9-41e0-b23c-5a2db56451c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.474156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc0a4a-5fe9-41e0-b23c-5a2db56451c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:28:17.474465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc0a4a-5fe9-41e0-b23c-5a2db56451c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:17.476120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dc0a4a-5fe9-41e0-b23c-5a2db56451c9 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:17.488114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1377/2715] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:28:17.493608 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8e447-3501-48fc-b3a1-82a234f8a6a8 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:17.503031 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e8e447-3501-48fc-b3a1-82a234f8a6a8 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:17.508785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c90e94-4cfc-4c9c-bee0-9fbdb7afebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:17.509432 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c90e94-4cfc-4c9c-bee0-9fbdb7afebf4 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.509716 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c90e94-4cfc-4c9c-bee0-9fbdb7afebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.509994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c90e94-4cfc-4c9c-bee0-9fbdb7afebf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.510692 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c90e94-4cfc-4c9c-bee0-9fbdb7afebf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:17.512637 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c90e94-4cfc-4c9c-bee0-9fbdb7afebf4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:17.537932 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1339/2716] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:28:17 2022] POST /identity/v3/projects => generated 393 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:17.542436 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc0a4a-5fe9-41e0-b23c-5a2db56451c9 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:17.552293 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc0a4a-5fe9-41e0-b23c-5a2db56451c9 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:17.609044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903f1bd-9f62-4e80-913e-5e43735dee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:17.609712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903f1bd-9f62-4e80-913e-5e43735dee6c admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.609996 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903f1bd-9f62-4e80-913e-5e43735dee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.610275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903f1bd-9f62-4e80-913e-5e43735dee6c admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.611031 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903f1bd-9f62-4e80-913e-5e43735dee6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:17.612946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903f1bd-9f62-4e80-913e-5e43735dee6c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:17.632882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1378/2717] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:28:17 2022] POST /identity/v3/users => generated 297 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:17.637331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c90e94-4cfc-4c9c-bee0-9fbdb7afebf4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:17.649788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c90e94-4cfc-4c9c-bee0-9fbdb7afebf4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:17.654614 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aa4fe-1bc2-42d4-80ed-d5868826b7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:17.655305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aa4fe-1bc2-42d4-80ed-d5868826b7f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.655587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aa4fe-1bc2-42d4-80ed-d5868826b7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.655862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033aa4fe-1bc2-42d4-80ed-d5868826b7f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.656580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033aa4fe-1bc2-42d4-80ed-d5868826b7f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:17.658184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033aa4fe-1bc2-42d4-80ed-d5868826b7f5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:17.668677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1340/2718] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:17.672699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903f1bd-9f62-4e80-913e-5e43735dee6c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:17.682721 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903f1bd-9f62-4e80-913e-5e43735dee6c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:17.687321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6a32de-c828-4f64-aad9-9d376b3b9805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:17.687971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a32de-c828-4f64-aad9-9d376b3b9805 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.688252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a32de-c828-4f64-aad9-9d376b3b9805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.688526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6a32de-c828-4f64-aad9-9d376b3b9805 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.689246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a32de-c828-4f64-aad9-9d376b3b9805 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:17.690845 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6a32de-c828-4f64-aad9-9d376b3b9805 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:17.692868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:17.707192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1379/2719] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:17.708340 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aa4fe-1bc2-42d4-80ed-d5868826b7f5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:17.719164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033aa4fe-1bc2-42d4-80ed-d5868826b7f5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:17.723769 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e1a0b-9851-4e51-b17d-f18597b585ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:17.724640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e1a0b-9851-4e51-b17d-f18597b585ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.724928 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e1a0b-9851-4e51-b17d-f18597b585ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.725206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52e1a0b-9851-4e51-b17d-f18597b585ec admin admin] PATH_INFO: `/v3/projects/03c3323ee3e14574a412f2e1233034ad/users/7acb8226c75e4c3bb233970e2913c000/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.739813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e1a0b-9851-4e51-b17d-f18597b585ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c3323ee3e14574a412f2e1233034ad, user_id=7acb8226c75e4c3bb233970e2913c000, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:17.742793 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52e1a0b-9851-4e51-b17d-f18597b585ec admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:17.755427 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1341/2720] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:17 2022] PUT /identity/v3/projects/03c3323ee3e14574a412f2e1233034ad/users/7acb8226c75e4c3bb233970e2913c000/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:28:17.766219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e132-a4d1-4a28-9fa1-dae2b5cea8de None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.766501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e132-a4d1-4a28-9fa1-dae2b5cea8de None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.766781 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a347e132-a4d1-4a28-9fa1-dae2b5cea8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.793323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a347e132-a4d1-4a28-9fa1-dae2b5cea8de None None] MFA Rules not processed for user `7acb8226c75e4c3bb233970e2913c000`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:17.794534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a347e132-a4d1-4a28-9fa1-dae2b5cea8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:17.857539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1380/2721] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:17.862145 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e1a0b-9851-4e51-b17d-f18597b585ec admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:17.924847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52e1a0b-9851-4e51-b17d-f18597b585ec admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:17.929494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196982-8731-4e6d-a071-1e95be5464b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:17.930317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196982-8731-4e6d-a071-1e95be5464b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:17.930600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196982-8731-4e6d-a071-1e95be5464b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:17.930874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5196982-8731-4e6d-a071-1e95be5464b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:17.931697 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196982-8731-4e6d-a071-1e95be5464b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:17.933589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5196982-8731-4e6d-a071-1e95be5464b4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:17.958393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1342/2722] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:28:17 2022] POST /identity/v3/projects => generated 393 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:17.963516 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347e132-a4d1-4a28-9fa1-dae2b5cea8de None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:17.974136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a347e132-a4d1-4a28-9fa1-dae2b5cea8de None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:18.031437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d5287-3f49-4f0f-8138-6015b23a5c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:18.032035 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d5287-3f49-4f0f-8138-6015b23a5c68 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:18.032321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d5287-3f49-4f0f-8138-6015b23a5c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:18.032594 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d5287-3f49-4f0f-8138-6015b23a5c68 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:18.033276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d5287-3f49-4f0f-8138-6015b23a5c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:18.035225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d5287-3f49-4f0f-8138-6015b23a5c68 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:18.054666 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1381/2723] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:28:17 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:18.058743 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196982-8731-4e6d-a071-1e95be5464b4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:18.068911 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5196982-8731-4e6d-a071-1e95be5464b4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:18.074428 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd9206-520c-4679-befb-a9f066177871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:18.075143 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd9206-520c-4679-befb-a9f066177871 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:18.075430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd9206-520c-4679-befb-a9f066177871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:18.075705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd9206-520c-4679-befb-a9f066177871 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:18.076459 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd9206-520c-4679-befb-a9f066177871 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:18.078080 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd9206-520c-4679-befb-a9f066177871 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:18.088993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1343/2724] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:18.093053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d5287-3f49-4f0f-8138-6015b23a5c68 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:18.103178 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d5287-3f49-4f0f-8138-6015b23a5c68 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:18.107766 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f2cc9-c0bd-4720-affa-ca030012ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:18.108637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f2cc9-c0bd-4720-affa-ca030012ad83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:18.108922 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f2cc9-c0bd-4720-affa-ca030012ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:18.109199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346f2cc9-c0bd-4720-affa-ca030012ad83 admin admin] PATH_INFO: `/v3/projects/d81e6520f50e4c63987a386c66dbf48e/users/9a2bdbd10eda4fd58d44d8a926cdfaed/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:18.124316 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f2cc9-c0bd-4720-affa-ca030012ad83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81e6520f50e4c63987a386c66dbf48e, user_id=9a2bdbd10eda4fd58d44d8a926cdfaed, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:18.126988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346f2cc9-c0bd-4720-affa-ca030012ad83 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:18.140694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1382/2725] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:18 2022] PUT /identity/v3/projects/d81e6520f50e4c63987a386c66dbf48e/users/9a2bdbd10eda4fd58d44d8a926cdfaed/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:28:18.144567 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd9206-520c-4679-befb-a9f066177871 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:18.155197 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd9206-520c-4679-befb-a9f066177871 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:18.211961 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98962d-927e-4901-8fc4-167231895ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:18.212633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98962d-927e-4901-8fc4-167231895ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:18.212940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98962d-927e-4901-8fc4-167231895ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:18.213220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98962d-927e-4901-8fc4-167231895ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:18.213945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98962d-927e-4901-8fc4-167231895ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:18.215629 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98962d-927e-4901-8fc4-167231895ee4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:18.225443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1344/2726] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:18.229847 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f2cc9-c0bd-4720-affa-ca030012ad83 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:18.240046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346f2cc9-c0bd-4720-affa-ca030012ad83 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:18.245336 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81c18-1788-4049-a9a0-fe7c31a4f975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:18.246213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81c18-1788-4049-a9a0-fe7c31a4f975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:18.246494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81c18-1788-4049-a9a0-fe7c31a4f975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:18.246768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be81c18-1788-4049-a9a0-fe7c31a4f975 admin admin] PATH_INFO: `/v3/projects/d81e6520f50e4c63987a386c66dbf48e/users/9a2bdbd10eda4fd58d44d8a926cdfaed/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:18.248747 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be81c18-1788-4049-a9a0-fe7c31a4f975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81e6520f50e4c63987a386c66dbf48e, user_id=9a2bdbd10eda4fd58d44d8a926cdfaed, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:18.251412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be81c18-1788-4049-a9a0-fe7c31a4f975 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:18.262431 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1383/2727] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:18 2022] PUT /identity/v3/projects/d81e6520f50e4c63987a386c66dbf48e/users/9a2bdbd10eda4fd58d44d8a926cdfaed/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:28:18.272506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1eac-e763-4aae-858f-42ce8d04230f None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:18.273018 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1eac-e763-4aae-858f-42ce8d04230f None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:18.273216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ed1eac-e763-4aae-858f-42ce8d04230f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:18.292533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:18.300073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-f1ed1eac-e763-4aae-858f-42ce8d04230f None None] MFA Rules not processed for user `9a2bdbd10eda4fd58d44d8a926cdfaed`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:18.301828 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f1ed1eac-e763-4aae-858f-42ce8d04230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:18.368299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1345/2728] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:18 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:18.379708 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81c18-1788-4049-a9a0-fe7c31a4f975 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:18.381455 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7be81c18-1788-4049-a9a0-fe7c31a4f975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:18.424915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:18.439413 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be81c18-1788-4049-a9a0-fe7c31a4f975 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:18.443091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccaefe-7c44-42f2-ada9-f5950dbb8a71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:18.443734 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccaefe-7c44-42f2-ada9-f5950dbb8a71 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:18.444030 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccaefe-7c44-42f2-ada9-f5950dbb8a71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:18.444302 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eccaefe-7c44-42f2-ada9-f5950dbb8a71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:18.453872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccaefe-7c44-42f2-ada9-f5950dbb8a71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:18.455370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eccaefe-7c44-42f2-ada9-f5950dbb8a71 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:18.465011 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1384/2729] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:18.509969 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed1eac-e763-4aae-858f-42ce8d04230f None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:18.511375 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f1ed1eac-e763-4aae-858f-42ce8d04230f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:18.523321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ed1eac-e763-4aae-858f-42ce8d04230f None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:18.526855 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5cac4-3ef0-487e-a71e-fca01659b811 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:18.527522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5cac4-3ef0-487e-a71e-fca01659b811 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:18.527801 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5cac4-3ef0-487e-a71e-fca01659b811 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:18.528077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5cac4-3ef0-487e-a71e-fca01659b811 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:18.583749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5cac4-3ef0-487e-a71e-fca01659b811 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:18.585110 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5cac4-3ef0-487e-a71e-fca01659b811 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:18.594615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1346/2730] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:21.832396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccaefe-7c44-42f2-ada9-f5950dbb8a71 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:21.893402 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eccaefe-7c44-42f2-ada9-f5950dbb8a71 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:21.897839 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:21.898762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:21.899069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:21.899348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] PATH_INFO: `/v3/users/7acb8226c75e4c3bb233970e2913c000` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:21.900526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7acb8226c75e4c3bb233970e2913c000)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:21.902475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:21.948235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7acb8226c75e4c3bb233970e2913c000'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:21.948878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7acb8226c75e4c3bb233970e2913c000'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:21.949476 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7acb8226c75e4c3bb233970e2913c000'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:21.956242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7acb8226c75e4c3bb233970e2913c000'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:21.963357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7acb8226c75e4c3bb233970e2913c000'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:21.980602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1385/2731] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:28:21 2022] DELETE /identity/v3/users/7acb8226c75e4c3bb233970e2913c000 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:21.985186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae40409-79c2-4fa3-bd7e-809ffb676efc None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:21.985683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae40409-79c2-4fa3-bd7e-809ffb676efc None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:21.985804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae40409-79c2-4fa3-bd7e-809ffb676efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:22.004166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-6ae40409-79c2-4fa3-bd7e-809ffb676efc None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:22.005358 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6ae40409-79c2-4fa3-bd7e-809ffb676efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:22.064750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1347/2732] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:22.075141 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:22.076551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:22.133596 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39835d6b-e49e-429f-b608-03543c04e70a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:22.137245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71a674-b05a-4bd0-b2cd-52197da8ced7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:22.137884 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71a674-b05a-4bd0-b2cd-52197da8ced7 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:22.138165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71a674-b05a-4bd0-b2cd-52197da8ced7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:22.138441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a71a674-b05a-4bd0-b2cd-52197da8ced7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:22.147325 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71a674-b05a-4bd0-b2cd-52197da8ced7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:22.149322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a71a674-b05a-4bd0-b2cd-52197da8ced7 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:22.158822 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1386/2733] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:22.431695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae40409-79c2-4fa3-bd7e-809ffb676efc None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:22.433214 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6ae40409-79c2-4fa3-bd7e-809ffb676efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:22.446117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae40409-79c2-4fa3-bd7e-809ffb676efc None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:22.451500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:22.452365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:22.452645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:22.452933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] PATH_INFO: `/v3/projects/03c3323ee3e14574a412f2e1233034ad` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:22.462417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c3323ee3e14574a412f2e1233034ad)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:22.464461 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:22.499131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:22.512764 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c3323ee3e14574a412f2e1233034ad', 'request_id': 'req-e98cedad-d1a4-42d0-89f8-b666eb874c13'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:22.519677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c3323ee3e14574a412f2e1233034ad', 'request_id': 'req-e98cedad-d1a4-42d0-89f8-b666eb874c13'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:22.525985 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c3323ee3e14574a412f2e1233034ad', 'request_id': 'req-e98cedad-d1a4-42d0-89f8-b666eb874c13'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:22.537083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] The token cache is being invalidate because project 03c3323ee3e14574a412f2e1233034ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:28:22.537372 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:22.538005 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:22.540144 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1348/2734] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:28:22 2022] DELETE /identity/v3/projects/03c3323ee3e14574a412f2e1233034ad => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:22.544182 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71a674-b05a-4bd0-b2cd-52197da8ced7 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:22.550106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:22.554181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a71a674-b05a-4bd0-b2cd-52197da8ced7 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:22.613637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:22.614539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:22.614850 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:22.615164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] PATH_INFO: `/v3/users/9a2bdbd10eda4fd58d44d8a926cdfaed` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:22.616377 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a2bdbd10eda4fd58d44d8a926cdfaed)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:22.618540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:22.662266 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a2bdbd10eda4fd58d44d8a926cdfaed'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:22.662913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a2bdbd10eda4fd58d44d8a926cdfaed'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:22.663549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a2bdbd10eda4fd58d44d8a926cdfaed'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:22.671088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a2bdbd10eda4fd58d44d8a926cdfaed'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:22.678202 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b4b7df82-89c8-4bab-873f-b9495b201a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a2bdbd10eda4fd58d44d8a926cdfaed'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:22.696161 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1387/2735] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:28:22 2022] DELETE /identity/v3/users/9a2bdbd10eda4fd58d44d8a926cdfaed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:22.965037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:22.966739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:22.983202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cedad-d1a4-42d0-89f8-b666eb874c13 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.045011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.045876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.046157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.046430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] PATH_INFO: `/v3/projects/d81e6520f50e4c63987a386c66dbf48e` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.047627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81e6520f50e4c63987a386c66dbf48e)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.049532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.103605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81e6520f50e4c63987a386c66dbf48e', 'request_id': 'req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:23.111099 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81e6520f50e4c63987a386c66dbf48e', 'request_id': 'req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:23.116942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81e6520f50e4c63987a386c66dbf48e', 'request_id': 'req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:23.129040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] The token cache is being invalidate because project d81e6520f50e4c63987a386c66dbf48e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:28:23.129336 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:23.129992 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-937bc9c7-938d-4dd5-8b8d-9c3aafc75f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:23.131589 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1349/2736] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:28:22 2022] DELETE /identity/v3/projects/d81e6520f50e4c63987a386c66dbf48e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:28:23.136674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461939b8-7695-431f-a6f5-9d5bc65e5c1b None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.137142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461939b8-7695-431f-a6f5-9d5bc65e5c1b None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.137255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461939b8-7695-431f-a6f5-9d5bc65e5c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.156039 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-461939b8-7695-431f-a6f5-9d5bc65e5c1b None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:23.157272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-461939b8-7695-431f-a6f5-9d5bc65e5c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:23.221157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1388/2737] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:28:23.230616 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab1584-1296-4663-9b63-c3d3dbd8f6ce None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.230905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab1584-1296-4663-9b63-c3d3dbd8f6ce None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.231243 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eab1584-1296-4663-9b63-c3d3dbd8f6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.252065 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-7eab1584-1296-4663-9b63-c3d3dbd8f6ce None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:23.253366 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7eab1584-1296-4663-9b63-c3d3dbd8f6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:23.263003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1350/2738] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:23.266559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461939b8-7695-431f-a6f5-9d5bc65e5c1b None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.278019 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461939b8-7695-431f-a6f5-9d5bc65e5c1b None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.283143 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad52bc9-76f1-44f6-89b7-ff327594993d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.283818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52bc9-76f1-44f6-89b7-ff327594993d admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.284232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52bc9-76f1-44f6-89b7-ff327594993d admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.284510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad52bc9-76f1-44f6-89b7-ff327594993d admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.285240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad52bc9-76f1-44f6-89b7-ff327594993d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:28:23.285550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad52bc9-76f1-44f6-89b7-ff327594993d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.287199 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad52bc9-76f1-44f6-89b7-ff327594993d admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.299740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1389/2739] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:28:23.303990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab1584-1296-4663-9b63-c3d3dbd8f6ce None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.314774 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eab1584-1296-4663-9b63-c3d3dbd8f6ce None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.319728 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b453e1-348e-49af-ad0e-84895e0a3ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.320392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b453e1-348e-49af-ad0e-84895e0a3ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.320669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b453e1-348e-49af-ad0e-84895e0a3ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.320948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b453e1-348e-49af-ad0e-84895e0a3ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.321693 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b453e1-348e-49af-ad0e-84895e0a3ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.323744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b453e1-348e-49af-ad0e-84895e0a3ed7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.350993 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1351/2740] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:28:23 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:28:23.355486 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad52bc9-76f1-44f6-89b7-ff327594993d admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.365584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad52bc9-76f1-44f6-89b7-ff327594993d admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.374100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:23.427672 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308868b1-413d-4493-be5e-15d662c15d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.428357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308868b1-413d-4493-be5e-15d662c15d7b admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.428797 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308868b1-413d-4493-be5e-15d662c15d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.429087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308868b1-413d-4493-be5e-15d662c15d7b admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.429782 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308868b1-413d-4493-be5e-15d662c15d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.432304 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308868b1-413d-4493-be5e-15d662c15d7b admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.459089 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1390/2741] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:28:23 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:23.460261 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b453e1-348e-49af-ad0e-84895e0a3ed7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.471356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b453e1-348e-49af-ad0e-84895e0a3ed7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.476075 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27078c9-4d74-4d0c-8f8a-1647e9a62f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.476737 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27078c9-4d74-4d0c-8f8a-1647e9a62f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.477025 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27078c9-4d74-4d0c-8f8a-1647e9a62f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.477307 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27078c9-4d74-4d0c-8f8a-1647e9a62f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.478630 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27078c9-4d74-4d0c-8f8a-1647e9a62f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.480271 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27078c9-4d74-4d0c-8f8a-1647e9a62f60 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.491536 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1352/2742] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:28:23.495904 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308868b1-413d-4493-be5e-15d662c15d7b admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.505949 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308868b1-413d-4493-be5e-15d662c15d7b admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.511054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d402b3-8653-41c7-a082-84a218f408f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.511715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d402b3-8653-41c7-a082-84a218f408f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.512010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d402b3-8653-41c7-a082-84a218f408f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.512270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d402b3-8653-41c7-a082-84a218f408f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.513012 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d402b3-8653-41c7-a082-84a218f408f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.514635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d402b3-8653-41c7-a082-84a218f408f7 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.525505 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1391/2743] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:23.530017 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27078c9-4d74-4d0c-8f8a-1647e9a62f60 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.540275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27078c9-4d74-4d0c-8f8a-1647e9a62f60 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.545517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29232536-a842-4452-9c4b-fb3b5ac9b86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.546415 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29232536-a842-4452-9c4b-fb3b5ac9b86e admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.546703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29232536-a842-4452-9c4b-fb3b5ac9b86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.547003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29232536-a842-4452-9c4b-fb3b5ac9b86e admin admin] PATH_INFO: `/v3/projects/df64fb00126042c79d504d0734b705e2/users/4af78e30a4664356aa441f2ed607d985/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.549919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:23.563842 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29232536-a842-4452-9c4b-fb3b5ac9b86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df64fb00126042c79d504d0734b705e2, user_id=4af78e30a4664356aa441f2ed607d985, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.566485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29232536-a842-4452-9c4b-fb3b5ac9b86e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.578891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1353/2744] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:23 2022] PUT /identity/v3/projects/df64fb00126042c79d504d0734b705e2/users/4af78e30a4664356aa441f2ed607d985/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:28:23.589675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b1f6f-3180-4f24-9964-9a9a04c7d8db None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.589968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b1f6f-3180-4f24-9964-9a9a04c7d8db None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.590252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b1f6f-3180-4f24-9964-9a9a04c7d8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.616322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-016b1f6f-3180-4f24-9964-9a9a04c7d8db None None] MFA Rules not processed for user `4af78e30a4664356aa441f2ed607d985`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:23.617526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-016b1f6f-3180-4f24-9964-9a9a04c7d8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:23.682869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1392/2745] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:23.687513 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29232536-a842-4452-9c4b-fb3b5ac9b86e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.749611 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29232536-a842-4452-9c4b-fb3b5ac9b86e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.754237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836686-c41b-4344-99c0-ef9ac61b7d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.754865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836686-c41b-4344-99c0-ef9ac61b7d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.755180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836686-c41b-4344-99c0-ef9ac61b7d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.755463 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836686-c41b-4344-99c0-ef9ac61b7d49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.756157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe836686-c41b-4344-99c0-ef9ac61b7d49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.758107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe836686-c41b-4344-99c0-ef9ac61b7d49 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.785095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1354/2746] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:28:23 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:23.789140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b1f6f-3180-4f24-9964-9a9a04c7d8db None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.799896 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b1f6f-3180-4f24-9964-9a9a04c7d8db None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.855864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4f532-fef1-4bd7-9272-cf372f74a4b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.856528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4f532-fef1-4bd7-9272-cf372f74a4b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.856810 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4f532-fef1-4bd7-9272-cf372f74a4b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.857085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4f532-fef1-4bd7-9272-cf372f74a4b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.857761 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4f532-fef1-4bd7-9272-cf372f74a4b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.859712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4f532-fef1-4bd7-9272-cf372f74a4b7 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.879588 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1393/2747] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:28:23 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:28:23.883235 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836686-c41b-4344-99c0-ef9ac61b7d49 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.894189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe836686-c41b-4344-99c0-ef9ac61b7d49 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.898851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f14e4-4306-449c-9984-fb7b2f92e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.899535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f14e4-4306-449c-9984-fb7b2f92e45c admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.900638 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f14e4-4306-449c-9984-fb7b2f92e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.900927 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f14e4-4306-449c-9984-fb7b2f92e45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.901666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f14e4-4306-449c-9984-fb7b2f92e45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.903318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726f14e4-4306-449c-9984-fb7b2f92e45c admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.914851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1355/2748] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:23.920158 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4f532-fef1-4bd7-9272-cf372f74a4b7 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.930049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4f532-fef1-4bd7-9272-cf372f74a4b7 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:23.935453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e1c6c-c3f2-4301-b36d-e0fade8f074f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:23.936330 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e1c6c-c3f2-4301-b36d-e0fade8f074f admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:23.936620 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e1c6c-c3f2-4301-b36d-e0fade8f074f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:23.936897 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e1c6c-c3f2-4301-b36d-e0fade8f074f admin admin] PATH_INFO: `/v3/projects/7e775f1158bf4fd4a7ce3f1ab8e7bfdc/users/b0b24a2958364c04b8b801e45ab6ce31/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:23.939917 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:23.952990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e1c6c-c3f2-4301-b36d-e0fade8f074f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e775f1158bf4fd4a7ce3f1ab8e7bfdc, user_id=b0b24a2958364c04b8b801e45ab6ce31, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:23.955719 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5e1c6c-c3f2-4301-b36d-e0fade8f074f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:23.968459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1394/2749] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:23 2022] PUT /identity/v3/projects/7e775f1158bf4fd4a7ce3f1ab8e7bfdc/users/b0b24a2958364c04b8b801e45ab6ce31/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:28:23.972426 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f14e4-4306-449c-9984-fb7b2f92e45c admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:23.982929 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f14e4-4306-449c-9984-fb7b2f92e45c admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:24.041865 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfff7db-beeb-4ca3-9049-9dbca02c64b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:24.042499 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfff7db-beeb-4ca3-9049-9dbca02c64b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:24.042789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfff7db-beeb-4ca3-9049-9dbca02c64b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:24.043087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfff7db-beeb-4ca3-9049-9dbca02c64b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:24.043815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfff7db-beeb-4ca3-9049-9dbca02c64b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:24.045402 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfff7db-beeb-4ca3-9049-9dbca02c64b3 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:24.055410 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1356/2750] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:24.059728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e1c6c-c3f2-4301-b36d-e0fade8f074f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:24.070057 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5e1c6c-c3f2-4301-b36d-e0fade8f074f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:24.074790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c74a7-f96f-4829-bed5-86c71e112613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:24.075687 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c74a7-f96f-4829-bed5-86c71e112613 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:24.075970 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c74a7-f96f-4829-bed5-86c71e112613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:24.076246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9c74a7-f96f-4829-bed5-86c71e112613 admin admin] PATH_INFO: `/v3/projects/7e775f1158bf4fd4a7ce3f1ab8e7bfdc/users/b0b24a2958364c04b8b801e45ab6ce31/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:24.078211 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c74a7-f96f-4829-bed5-86c71e112613 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e775f1158bf4fd4a7ce3f1ab8e7bfdc, user_id=b0b24a2958364c04b8b801e45ab6ce31, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:24.080893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9c74a7-f96f-4829-bed5-86c71e112613 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:24.091567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1395/2751] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:24 2022] PUT /identity/v3/projects/7e775f1158bf4fd4a7ce3f1ab8e7bfdc/users/b0b24a2958364c04b8b801e45ab6ce31/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:24.102634 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376f1c2-1d5f-4c95-86c9-c40a1f1a5c09 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:24.103660 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376f1c2-1d5f-4c95-86c9-c40a1f1a5c09 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:24.104170 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e376f1c2-1d5f-4c95-86c9-c40a1f1a5c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:24.130361 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-e376f1c2-1d5f-4c95-86c9-c40a1f1a5c09 None None] MFA Rules not processed for user `b0b24a2958364c04b8b801e45ab6ce31`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:24.131591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e376f1c2-1d5f-4c95-86c9-c40a1f1a5c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:24.174084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:24.200563 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1357/2752] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:24 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:24.211808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c74a7-f96f-4829-bed5-86c71e112613 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:24.213753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7c9c74a7-f96f-4829-bed5-86c71e112613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:24.269965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9c74a7-f96f-4829-bed5-86c71e112613 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:24.273541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12149-9e45-4c84-a95d-a0adc37fc1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:24.274171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12149-9e45-4c84-a95d-a0adc37fc1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:24.274452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12149-9e45-4c84-a95d-a0adc37fc1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:24.274728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb12149-9e45-4c84-a95d-a0adc37fc1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:24.283859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb12149-9e45-4c84-a95d-a0adc37fc1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:24.285287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb12149-9e45-4c84-a95d-a0adc37fc1b9 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:24.294694 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1396/2753] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:24 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:24.370748 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376f1c2-1d5f-4c95-86c9-c40a1f1a5c09 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:24.380339 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e376f1c2-1d5f-4c95-86c9-c40a1f1a5c09 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:24.383881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ddeca-14b4-4476-b3bf-851b9ae8f948 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:24.384677 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ddeca-14b4-4476-b3bf-851b9ae8f948 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:24.384959 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ddeca-14b4-4476-b3bf-851b9ae8f948 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:24.385240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ddeca-14b4-4476-b3bf-851b9ae8f948 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:24.447397 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ddeca-14b4-4476-b3bf-851b9ae8f948 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:24.448837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ddeca-14b4-4476-b3bf-851b9ae8f948 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:24.457675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1358/2754] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:24 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:29.138879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12149-9e45-4c84-a95d-a0adc37fc1b9 service cinder] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:29.201408 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb12149-9e45-4c84-a95d-a0adc37fc1b9 service cinder] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:29.205961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:29.206838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:29.207156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:29.207439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] PATH_INFO: `/v3/users/4af78e30a4664356aa441f2ed607d985` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:29.208643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af78e30a4664356aa441f2ed607d985)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:29.210602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:29.257400 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af78e30a4664356aa441f2ed607d985'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.257987 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af78e30a4664356aa441f2ed607d985'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.258602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af78e30a4664356aa441f2ed607d985'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.265500 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af78e30a4664356aa441f2ed607d985'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.272768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af78e30a4664356aa441f2ed607d985'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.283683 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:29.292270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1397/2755] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:28:29 2022] DELETE /identity/v3/users/4af78e30a4664356aa441f2ed607d985 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:29.296892 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068fce9-05b4-4198-b015-c513c6870993 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:29.297390 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068fce9-05b4-4198-b015-c513c6870993 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:29.297493 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068fce9-05b4-4198-b015-c513c6870993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:29.314440 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-d068fce9-05b4-4198-b015-c513c6870993 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:29.315682 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d068fce9-05b4-4198-b015-c513c6870993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:29.376702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1359/2756] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:29.387454 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:29.388889 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:29.447720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9a50e-1715-4405-b9e9-5bf7518e2d29 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:29.452066 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59354a57-8f47-42f0-9fa8-3c7999b0712f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:29.452829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59354a57-8f47-42f0-9fa8-3c7999b0712f service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:29.453000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59354a57-8f47-42f0-9fa8-3c7999b0712f service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:29.453277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59354a57-8f47-42f0-9fa8-3c7999b0712f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:29.463265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59354a57-8f47-42f0-9fa8-3c7999b0712f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:29.464876 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59354a57-8f47-42f0-9fa8-3c7999b0712f service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:29.474525 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1398/2757] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:29.751234 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068fce9-05b4-4198-b015-c513c6870993 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:29.752711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d068fce9-05b4-4198-b015-c513c6870993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:29.766509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068fce9-05b4-4198-b015-c513c6870993 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:29.771300 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:29.772164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:29.772446 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:29.772723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] PATH_INFO: `/v3/projects/df64fb00126042c79d504d0734b705e2` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:29.773912 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=df64fb00126042c79d504d0734b705e2)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:29.775884 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:29.825228 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df64fb00126042c79d504d0734b705e2', 'request_id': 'req-4714fe10-4160-4010-8140-1c2db3ef58ec'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.832250 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df64fb00126042c79d504d0734b705e2', 'request_id': 'req-4714fe10-4160-4010-8140-1c2db3ef58ec'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.837813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df64fb00126042c79d504d0734b705e2', 'request_id': 'req-4714fe10-4160-4010-8140-1c2db3ef58ec'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.848751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] The token cache is being invalidate because project df64fb00126042c79d504d0734b705e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:28:29.849036 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.849656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.851213 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1360/2758] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:28:29 2022] DELETE /identity/v3/projects/df64fb00126042c79d504d0734b705e2 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:29.856038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59354a57-8f47-42f0-9fa8-3c7999b0712f service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:29.865650 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59354a57-8f47-42f0-9fa8-3c7999b0712f service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:29.922227 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:29.923119 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:29.923406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:29.923676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] PATH_INFO: `/v3/users/b0b24a2958364c04b8b801e45ab6ce31` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:29.924986 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b24a2958364c04b8b801e45ab6ce31)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:29.926920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:29.973294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b24a2958364c04b8b801e45ab6ce31'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.974249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b24a2958364c04b8b801e45ab6ce31'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.974853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b24a2958364c04b8b801e45ab6ce31'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.982321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b24a2958364c04b8b801e45ab6ce31'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:29.989548 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-e8c9ebe7-5af3-4dc6-9d3e-eead6f70e243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b24a2958364c04b8b801e45ab6ce31'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:30.007946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1399/2759] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:28:29 2022] DELETE /identity/v3/users/b0b24a2958364c04b8b801e45ab6ce31 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:28:30.278810 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:30.280644 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:30.288987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:30.296181 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714fe10-4160-4010-8140-1c2db3ef58ec admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:30.354861 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:30.355643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:30.355931 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:30.356211 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] PATH_INFO: `/v3/projects/7e775f1158bf4fd4a7ce3f1ab8e7bfdc` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:30.357407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e775f1158bf4fd4a7ce3f1ab8e7bfdc)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:30.359400 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:30.404742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e775f1158bf4fd4a7ce3f1ab8e7bfdc', 'request_id': 'req-6347884d-22f5-48a6-ba67-32bf31b355e0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:30.411395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e775f1158bf4fd4a7ce3f1ab8e7bfdc', 'request_id': 'req-6347884d-22f5-48a6-ba67-32bf31b355e0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:30.417874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e775f1158bf4fd4a7ce3f1ab8e7bfdc', 'request_id': 'req-6347884d-22f5-48a6-ba67-32bf31b355e0'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:30.428727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] The token cache is being invalidate because project 7e775f1158bf4fd4a7ce3f1ab8e7bfdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:28:30.429011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:30.429636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-6347884d-22f5-48a6-ba67-32bf31b355e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:30.431179 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1361/2760] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:28:30 2022] DELETE /identity/v3/projects/7e775f1158bf4fd4a7ce3f1ab8e7bfdc => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:30.436971 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae5973-68a1-40f3-8878-e6b0247ff723 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:30.437437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae5973-68a1-40f3-8878-e6b0247ff723 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:30.437552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ae5973-68a1-40f3-8878-e6b0247ff723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:30.455247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-56ae5973-68a1-40f3-8878-e6b0247ff723 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:30.456471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-56ae5973-68a1-40f3-8878-e6b0247ff723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:30.466221 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:30.517027 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1400/2761] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:30.524758 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c264fc9-bc12-43be-837f-e92cb7eacb39 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:30.525050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c264fc9-bc12-43be-837f-e92cb7eacb39 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:30.525333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c264fc9-bc12-43be-837f-e92cb7eacb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:30.545003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-8c264fc9-bc12-43be-837f-e92cb7eacb39 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:30.546218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8c264fc9-bc12-43be-837f-e92cb7eacb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:30.554218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1362/2762] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:30.558278 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae5973-68a1-40f3-8878-e6b0247ff723 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:30.568487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ae5973-68a1-40f3-8878-e6b0247ff723 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:30.573152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d0b24-4644-4198-b006-60df29c463ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:30.573785 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d0b24-4644-4198-b006-60df29c463ac admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:30.574075 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d0b24-4644-4198-b006-60df29c463ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:30.574355 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d0b24-4644-4198-b006-60df29c463ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:30.575126 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d0b24-4644-4198-b006-60df29c463ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:28:30.575439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d0b24-4644-4198-b006-60df29c463ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:30.577096 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d0b24-4644-4198-b006-60df29c463ac admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:30.588607 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1401/2763] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:28:30.593058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c264fc9-bc12-43be-837f-e92cb7eacb39 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:30.602296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c264fc9-bc12-43be-837f-e92cb7eacb39 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:30.607690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656c561-ba9c-4739-af84-1366e9325ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:30.608275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656c561-ba9c-4739-af84-1366e9325ba7 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:30.608561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656c561-ba9c-4739-af84-1366e9325ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:30.608840 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656c561-ba9c-4739-af84-1366e9325ba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:30.609536 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656c561-ba9c-4739-af84-1366e9325ba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:30.611477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656c561-ba9c-4739-af84-1366e9325ba7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:30.636841 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1363/2764] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:28:30 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:28:30.640689 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d0b24-4644-4198-b006-60df29c463ac admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:30.650590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d0b24-4644-4198-b006-60df29c463ac admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:30.709972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36e66f-edba-4b7d-83b5-ff01289bf838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:30.710643 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36e66f-edba-4b7d-83b5-ff01289bf838 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:30.710946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36e66f-edba-4b7d-83b5-ff01289bf838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:30.711230 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36e66f-edba-4b7d-83b5-ff01289bf838 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:30.712085 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36e66f-edba-4b7d-83b5-ff01289bf838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:30.714929 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36e66f-edba-4b7d-83b5-ff01289bf838 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:30.734509 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1402/2765] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:28:30 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:28:30.738727 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656c561-ba9c-4739-af84-1366e9325ba7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:30.749364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656c561-ba9c-4739-af84-1366e9325ba7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:30.754031 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01621c54-45aa-4db1-97c5-b3310bacc84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:30.754687 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01621c54-45aa-4db1-97c5-b3310bacc84f admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:30.754990 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01621c54-45aa-4db1-97c5-b3310bacc84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:30.755272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01621c54-45aa-4db1-97c5-b3310bacc84f admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:30.755989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01621c54-45aa-4db1-97c5-b3310bacc84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:30.757580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01621c54-45aa-4db1-97c5-b3310bacc84f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:30.769086 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1364/2766] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:30.772979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36e66f-edba-4b7d-83b5-ff01289bf838 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:30.783830 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36e66f-edba-4b7d-83b5-ff01289bf838 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:30.788430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6b6f6-cc00-4e08-a727-babffb709256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:30.789087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b6f6-cc00-4e08-a727-babffb709256 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:30.789375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b6f6-cc00-4e08-a727-babffb709256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:30.789658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6b6f6-cc00-4e08-a727-babffb709256 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:30.790388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6b6f6-cc00-4e08-a727-babffb709256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:30.792676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6b6f6-cc00-4e08-a727-babffb709256 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:30.802608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1403/2767] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:30.806872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01621c54-45aa-4db1-97c5-b3310bacc84f admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:30.816756 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01621c54-45aa-4db1-97c5-b3310bacc84f admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:30.821691 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58647c37-9bc9-475c-8770-64b38280c35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:30.822566 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58647c37-9bc9-475c-8770-64b38280c35d admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:30.822847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58647c37-9bc9-475c-8770-64b38280c35d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:30.823202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58647c37-9bc9-475c-8770-64b38280c35d admin admin] PATH_INFO: `/v3/projects/bd9118895b744bd2a456dcc716eb7a1d/users/22a35a5c8a53461e933c8a250f61397d/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:30.837552 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58647c37-9bc9-475c-8770-64b38280c35d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd9118895b744bd2a456dcc716eb7a1d, user_id=22a35a5c8a53461e933c8a250f61397d, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:30.840763 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58647c37-9bc9-475c-8770-64b38280c35d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:30.852958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1365/2768] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:30 2022] PUT /identity/v3/projects/bd9118895b744bd2a456dcc716eb7a1d/users/22a35a5c8a53461e933c8a250f61397d/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:30.863710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08420fb8-85d5-421b-b946-89ae12aee47e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:30.863946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08420fb8-85d5-421b-b946-89ae12aee47e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:30.864226 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08420fb8-85d5-421b-b946-89ae12aee47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:30.890711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-08420fb8-85d5-421b-b946-89ae12aee47e None None] MFA Rules not processed for user `22a35a5c8a53461e933c8a250f61397d`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:30.891967 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-08420fb8-85d5-421b-b946-89ae12aee47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:30.955373 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1404/2769] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:30.967344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58647c37-9bc9-475c-8770-64b38280c35d admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:30.969051 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-58647c37-9bc9-475c-8770-64b38280c35d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:31.001603 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:31.028740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58647c37-9bc9-475c-8770-64b38280c35d admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:31.032673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc426d-fed5-4d22-9856-26735087e9df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:31.033317 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc426d-fed5-4d22-9856-26735087e9df service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:31.033624 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc426d-fed5-4d22-9856-26735087e9df service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:31.033898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc426d-fed5-4d22-9856-26735087e9df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:31.042783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc426d-fed5-4d22-9856-26735087e9df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:31.044245 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc426d-fed5-4d22-9856-26735087e9df service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:31.052930 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1366/2770] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:31.071695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08420fb8-85d5-421b-b946-89ae12aee47e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:31.084552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:31.136424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08420fb8-85d5-421b-b946-89ae12aee47e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:31.140916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:31.141776 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:31.142055 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:31.142326 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] PATH_INFO: `/v3/users/22a35a5c8a53461e933c8a250f61397d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:31.143533 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a35a5c8a53461e933c8a250f61397d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:31.145460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:31.190801 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a35a5c8a53461e933c8a250f61397d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:31.191512 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a35a5c8a53461e933c8a250f61397d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:31.192130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a35a5c8a53461e933c8a250f61397d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:31.199441 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a35a5c8a53461e933c8a250f61397d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:31.207865 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a35a5c8a53461e933c8a250f61397d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:31.226621 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1405/2771] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:28:31 2022] DELETE /identity/v3/users/22a35a5c8a53461e933c8a250f61397d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:31.231514 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6563a4-aa9b-4b68-ad23-400b57c43977 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:31.231808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6563a4-aa9b-4b68-ad23-400b57c43977 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:31.232087 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6563a4-aa9b-4b68-ad23-400b57c43977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:31.249373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-bf6563a4-aa9b-4b68-ad23-400b57c43977 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:31.250580 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bf6563a4-aa9b-4b68-ad23-400b57c43977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:31.310602 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1367/2772] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:31.320183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:31.321872 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:31.379764 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d897eb1-d86b-485a-b549-2b692cdd9789 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:31.383511 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b67417-44ae-4ab6-8199-773eba9e7fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:31.384152 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b67417-44ae-4ab6-8199-773eba9e7fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:31.384438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b67417-44ae-4ab6-8199-773eba9e7fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:31.384718 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b67417-44ae-4ab6-8199-773eba9e7fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:31.394246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b67417-44ae-4ab6-8199-773eba9e7fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:31.395676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b67417-44ae-4ab6-8199-773eba9e7fc2 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:31.406357 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1406/2773] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:31.678794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6563a4-aa9b-4b68-ad23-400b57c43977 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:31.680312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bf6563a4-aa9b-4b68-ad23-400b57c43977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:31.692487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6563a4-aa9b-4b68-ad23-400b57c43977 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:31.697471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:31.698417 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:31.698685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:31.699180 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] PATH_INFO: `/v3/projects/bd9118895b744bd2a456dcc716eb7a1d` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:31.700414 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd9118895b744bd2a456dcc716eb7a1d)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:31.702464 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:31.750097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd9118895b744bd2a456dcc716eb7a1d', 'request_id': 'req-8c72a060-3d86-4793-afaf-5a12fb326c71'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:31.757291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd9118895b744bd2a456dcc716eb7a1d', 'request_id': 'req-8c72a060-3d86-4793-afaf-5a12fb326c71'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:31.762695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd9118895b744bd2a456dcc716eb7a1d', 'request_id': 'req-8c72a060-3d86-4793-afaf-5a12fb326c71'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:31.773471 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] The token cache is being invalidate because project bd9118895b744bd2a456dcc716eb7a1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:28:31.773760 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:31.774393 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-8c72a060-3d86-4793-afaf-5a12fb326c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:28:31.775967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1368/2774] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:28:31 2022] DELETE /identity/v3/projects/bd9118895b744bd2a456dcc716eb7a1d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:31.783234 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116253-33f1-4a6f-97b4-5b98ae79c2da None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:31.783710 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116253-33f1-4a6f-97b4-5b98ae79c2da None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:31.783817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99116253-33f1-4a6f-97b4-5b98ae79c2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:31.801943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-99116253-33f1-4a6f-97b4-5b98ae79c2da None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:31.803181 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-99116253-33f1-4a6f-97b4-5b98ae79c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:31.832741 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:31.864384 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1407/2775] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:31.874117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816ebc1-e280-4f9e-8c27-aeffcef82e62 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:31.874413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816ebc1-e280-4f9e-8c27-aeffcef82e62 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:31.874695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816ebc1-e280-4f9e-8c27-aeffcef82e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:31.893532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-9816ebc1-e280-4f9e-8c27-aeffcef82e62 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:31.894740 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9816ebc1-e280-4f9e-8c27-aeffcef82e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:31.903719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1369/2776] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:31.908016 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116253-33f1-4a6f-97b4-5b98ae79c2da None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:31.917614 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99116253-33f1-4a6f-97b4-5b98ae79c2da None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:31.922334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c67f00-ce41-46c5-a2ac-14c4ec67c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:31.922927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c67f00-ce41-46c5-a2ac-14c4ec67c029 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:31.923243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c67f00-ce41-46c5-a2ac-14c4ec67c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:31.923528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c67f00-ce41-46c5-a2ac-14c4ec67c029 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:31.924256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c67f00-ce41-46c5-a2ac-14c4ec67c029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:28:31.924564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c67f00-ce41-46c5-a2ac-14c4ec67c029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:31.926177 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c67f00-ce41-46c5-a2ac-14c4ec67c029 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:31.938026 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1408/2777] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:28:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 21 04:28:31.942290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816ebc1-e280-4f9e-8c27-aeffcef82e62 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:31.952518 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816ebc1-e280-4f9e-8c27-aeffcef82e62 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:31.957240 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dee26a-2420-4619-8ce7-5743451466e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:31.957881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dee26a-2420-4619-8ce7-5743451466e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:31.958166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dee26a-2420-4619-8ce7-5743451466e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:31.958443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dee26a-2420-4619-8ce7-5743451466e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:31.959167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dee26a-2420-4619-8ce7-5743451466e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:31.961067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dee26a-2420-4619-8ce7-5743451466e7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:31.987759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1370/2778] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:28:31 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:28:31.992303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c67f00-ce41-46c5-a2ac-14c4ec67c029 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:32.003392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c67f00-ce41-46c5-a2ac-14c4ec67c029 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:32.061004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a1d94-c065-49fd-a036-b25f6c8e2cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:32.061668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a1d94-c065-49fd-a036-b25f6c8e2cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:32.061955 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a1d94-c065-49fd-a036-b25f6c8e2cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:32.062236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a1d94-c065-49fd-a036-b25f6c8e2cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:32.062928 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a1d94-c065-49fd-a036-b25f6c8e2cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:32.064901 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632a1d94-c065-49fd-a036-b25f6c8e2cf5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:32.084857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1409/2779] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:28:31 2022] POST /identity/v3/users => generated 283 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:28:32.089011 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dee26a-2420-4619-8ce7-5743451466e7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:32.099534 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dee26a-2420-4619-8ce7-5743451466e7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:32.104346 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df5d72-747a-4802-90cd-67da881b15e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:32.105563 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df5d72-747a-4802-90cd-67da881b15e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:32.105846 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df5d72-747a-4802-90cd-67da881b15e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:32.106122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25df5d72-747a-4802-90cd-67da881b15e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:32.106879 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df5d72-747a-4802-90cd-67da881b15e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:32.108511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25df5d72-747a-4802-90cd-67da881b15e0 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:32.119160 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1371/2780] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:28:32.123698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a1d94-c065-49fd-a036-b25f6c8e2cf5 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:32.133520 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a1d94-c065-49fd-a036-b25f6c8e2cf5 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:32.138213 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a376a-847c-48c7-94b9-c3d289bf64f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:32.138860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a376a-847c-48c7-94b9-c3d289bf64f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:32.139196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a376a-847c-48c7-94b9-c3d289bf64f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:32.139473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a376a-847c-48c7-94b9-c3d289bf64f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:32.140198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a376a-847c-48c7-94b9-c3d289bf64f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:32.141795 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a376a-847c-48c7-94b9-c3d289bf64f0 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:32.151639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1410/2781] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:28:32.155553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df5d72-747a-4802-90cd-67da881b15e0 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:32.165662 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25df5d72-747a-4802-90cd-67da881b15e0 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:32.170941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba06403-c9c1-4f01-96ed-66ea1f81a6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:32.171849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba06403-c9c1-4f01-96ed-66ea1f81a6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:32.172132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba06403-c9c1-4f01-96ed-66ea1f81a6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:32.172458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba06403-c9c1-4f01-96ed-66ea1f81a6fc admin admin] PATH_INFO: `/v3/projects/46cabe8997354d23a5a958aeefa90f2e/users/cc23abbf71954418860cd0e302d202f8/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:32.185268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:32.188837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba06403-c9c1-4f01-96ed-66ea1f81a6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cabe8997354d23a5a958aeefa90f2e, user_id=cc23abbf71954418860cd0e302d202f8, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:32.192035 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba06403-c9c1-4f01-96ed-66ea1f81a6fc admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:32.208957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1372/2782] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:28:32 2022] PUT /identity/v3/projects/46cabe8997354d23a5a958aeefa90f2e/users/cc23abbf71954418860cd0e302d202f8/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:28:32.219956 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4f23-b702-43e9-b438-2ff800c49db4 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:32.220246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4f23-b702-43e9-b438-2ff800c49db4 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:32.220526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc4f23-b702-43e9-b438-2ff800c49db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:32.247198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b4dc4f23-b702-43e9-b438-2ff800c49db4 None None] MFA Rules not processed for user `cc23abbf71954418860cd0e302d202f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:28:32.248446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b4dc4f23-b702-43e9-b438-2ff800c49db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:32.313437 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1411/2783] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:28:32 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:28:32.325509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba06403-c9c1-4f01-96ed-66ea1f81a6fc admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:28:32.327238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fba06403-c9c1-4f01-96ed-66ea1f81a6fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:28:32.384148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba06403-c9c1-4f01-96ed-66ea1f81a6fc admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:28:32.387979 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82513b44-503e-4537-8b2c-0f42ddce05bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:28:32.388628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513b44-503e-4537-8b2c-0f42ddce05bf service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:28:32.388914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513b44-503e-4537-8b2c-0f42ddce05bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:28:32.389199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82513b44-503e-4537-8b2c-0f42ddce05bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:28:32.397500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82513b44-503e-4537-8b2c-0f42ddce05bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:28:32.398935 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82513b44-503e-4537-8b2c-0f42ddce05bf service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:28:32.408893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1373/2784] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:28:32 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:28:42.310421 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:28:42.405356 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=29,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:29:06.108927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc4f23-b702-43e9-b438-2ff800c49db4 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:29:06.172045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc4f23-b702-43e9-b438-2ff800c49db4 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:29:06.176528 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:29:06.177388 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:06.177668 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:06.177942 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] PATH_INFO: `/v3/users/cc23abbf71954418860cd0e302d202f8` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:06.179139 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc23abbf71954418860cd0e302d202f8)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:29:06.182257 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:29:06.230024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc23abbf71954418860cd0e302d202f8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:29:06.230674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc23abbf71954418860cd0e302d202f8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:29:06.231365 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc23abbf71954418860cd0e302d202f8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:29:06.238344 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc23abbf71954418860cd0e302d202f8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:29:06.245693 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc23abbf71954418860cd0e302d202f8'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:29:06.263039 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1412/2785] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:29:06 2022] DELETE /identity/v3/users/cc23abbf71954418860cd0e302d202f8 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:29:06.267508 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d686a7-cf5b-4162-8e34-2cf08a907459 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:06.268020 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d686a7-cf5b-4162-8e34-2cf08a907459 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:06.268130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d686a7-cf5b-4162-8e34-2cf08a907459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:06.285642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-b6d686a7-cf5b-4162-8e34-2cf08a907459 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:29:06.286839 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b6d686a7-cf5b-4162-8e34-2cf08a907459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:06.346921 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1374/2786] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:29:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:29:06.356864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:29:06.358462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:06.414857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbbb7c0-22db-4746-b8c8-00aad42efde2 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:29:06.418515 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08832ab9-e926-4ca5-90a0-4703247086aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:29:06.419186 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08832ab9-e926-4ca5-90a0-4703247086aa service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:06.419468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08832ab9-e926-4ca5-90a0-4703247086aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:06.419739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08832ab9-e926-4ca5-90a0-4703247086aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:06.428696 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08832ab9-e926-4ca5-90a0-4703247086aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:29:06.430353 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08832ab9-e926-4ca5-90a0-4703247086aa service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:29:06.439667 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1413/2787] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:29:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:29:06.699904 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d686a7-cf5b-4162-8e34-2cf08a907459 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:29:06.701378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b6d686a7-cf5b-4162-8e34-2cf08a907459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:06.714584 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d686a7-cf5b-4162-8e34-2cf08a907459 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:29:06.719321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:29:06.720177 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:06.720465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:06.720744 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] PATH_INFO: `/v3/projects/46cabe8997354d23a5a958aeefa90f2e` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:06.722033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46cabe8997354d23a5a958aeefa90f2e)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:29:06.723900 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:29:06.771303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46cabe8997354d23a5a958aeefa90f2e', 'request_id': 'req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:29:06.778743 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46cabe8997354d23a5a958aeefa90f2e', 'request_id': 'req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:29:06.784166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46cabe8997354d23a5a958aeefa90f2e', 'request_id': 'req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:29:06.800189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] The token cache is being invalidate because project 46cabe8997354d23a5a958aeefa90f2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:29:06.800480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:29:06.801131 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:29:06.802712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1375/2788] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:29:06 2022] DELETE /identity/v3/projects/46cabe8997354d23a5a958aeefa90f2e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:29:13.420609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08832ab9-e926-4ca5-90a0-4703247086aa service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:29:13.429396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08832ab9-e926-4ca5-90a0-4703247086aa service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:29:13.448799 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:29:13.482328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a8c4b-b1d4-427b-9c03-2e832d7fd448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:29:13.483100 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a8c4b-b1d4-427b-9c03-2e832d7fd448 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:13.483392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a8c4b-b1d4-427b-9c03-2e832d7fd448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:13.483674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a8c4b-b1d4-427b-9c03-2e832d7fd448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:13.485471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-180a8c4b-b1d4-427b-9c03-2e832d7fd448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:13.495465 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a8c4b-b1d4-427b-9c03-2e832d7fd448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:29:13.496912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180a8c4b-b1d4-427b-9c03-2e832d7fd448 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:29:13.504878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1414/2789] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:29:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:29:16.793048 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:29:19.913152 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:29:19.914881 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:20.014838 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c387f9-ce22-4b55-a3c9-7cba1aa0aa02 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:29:20.021532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a9db-e9da-4e44-bb95-25abb7bdc605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:29:20.022667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a9db-e9da-4e44-bb95-25abb7bdc605 service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:20.023309 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a9db-e9da-4e44-bb95-25abb7bdc605 service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:20.023856 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2a9db-e9da-4e44-bb95-25abb7bdc605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:20.027082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-97a2a9db-e9da-4e44-bb95-25abb7bdc605 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:20.045045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2a9db-e9da-4e44-bb95-25abb7bdc605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:29:20.047068 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2a9db-e9da-4e44-bb95-25abb7bdc605 service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:29:20.061380 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1376/2790] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:29:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:29:23.501297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=16 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:29:23.593723 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c369c3-24f9-40ce-ae9a-a653a3bdeec3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:23.594013 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c369c3-24f9-40ce-ae9a-a653a3bdeec3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:23.594292 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c369c3-24f9-40ce-ae9a-a653a3bdeec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:23.613287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-51c369c3-24f9-40ce-ae9a-a653a3bdeec3 None None] MFA Rules not processed for user `eeba43224b9240f8b0dfbf9c47a234e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:29:23.614531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-51c369c3-24f9-40ce-ae9a-a653a3bdeec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:23.678165 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1415/2791] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:29:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:29:24.288729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a9db-e9da-4e44-bb95-25abb7bdc605 service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:29:24.290184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-97a2a9db-e9da-4e44-bb95-25abb7bdc605 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:24.365059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2a9db-e9da-4e44-bb95-25abb7bdc605 service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:29:24.370096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cd65c-beaa-49d6-b373-1ea8ad9eceea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:29:24.370741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd65c-beaa-49d6-b373-1ea8ad9eceea service placement] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:24.371056 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd65c-beaa-49d6-b373-1ea8ad9eceea service placement] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:24.371977 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cd65c-beaa-49d6-b373-1ea8ad9eceea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:24.373772 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bf5cd65c-beaa-49d6-b373-1ea8ad9eceea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:24.385139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cd65c-beaa-49d6-b373-1ea8ad9eceea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:29:24.386732 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5cd65c-beaa-49d6-b373-1ea8ad9eceea service placement] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:29:24.396657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1377/2792] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:29:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:29:33.670965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=25 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:29:34.392449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=66 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:29:35.793990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c369c3-24f9-40ce-ae9a-a653a3bdeec3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:29:35.795559 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-51c369c3-24f9-40ce-ae9a-a653a3bdeec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:35.811879 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c369c3-24f9-40ce-ae9a-a653a3bdeec3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:29:35.817993 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52e42f-27bd-4a6d-8923-bf1cbee38635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:29:35.818713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52e42f-27bd-4a6d-8923-bf1cbee38635 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:29:35.819101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52e42f-27bd-4a6d-8923-bf1cbee38635 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:29:35.819385 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d52e42f-27bd-4a6d-8923-bf1cbee38635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:29:35.821140 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0d52e42f-27bd-4a6d-8923-bf1cbee38635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:29:35.834414 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52e42f-27bd-4a6d-8923-bf1cbee38635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:29:35.836035 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d52e42f-27bd-4a6d-8923-bf1cbee38635 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:29:35.847007 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1416/2793] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:29:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:29:45.842907 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=6 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:30:40.575738 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cd65c-beaa-49d6-b373-1ea8ad9eceea service placement] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:30:40.589337 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5cd65c-beaa-49d6-b373-1ea8ad9eceea service placement] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:30:40.595073 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1fb9-bad3-4a58-94f8-7f7f73ed3b4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:30:40.595723 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1fb9-bad3-4a58-94f8-7f7f73ed3b4a service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:30:40.596014 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1fb9-bad3-4a58-94f8-7f7f73ed3b4a service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:30:40.596295 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef1fb9-bad3-4a58-94f8-7f7f73ed3b4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:30:40.598083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bfef1fb9-bad3-4a58-94f8-7f7f73ed3b4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:30:40.609093 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef1fb9-bad3-4a58-94f8-7f7f73ed3b4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:30:40.610680 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef1fb9-bad3-4a58-94f8-7f7f73ed3b4a service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:30:40.620204 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1378/2794] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:30:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:30:50.615635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=6 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:00.744376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52e42f-27bd-4a6d-8923-bf1cbee38635 service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:00.745783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0d52e42f-27bd-4a6d-8923-bf1cbee38635 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:00.757277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d52e42f-27bd-4a6d-8923-bf1cbee38635 service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:00.761120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb4255-06e9-46d7-bb7f-1de9fe9bfa18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:00.761755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb4255-06e9-46d7-bb7f-1de9fe9bfa18 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:00.762041 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb4255-06e9-46d7-bb7f-1de9fe9bfa18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:00.762322 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbb4255-06e9-46d7-bb7f-1de9fe9bfa18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:00.764932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ecbb4255-06e9-46d7-bb7f-1de9fe9bfa18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:00.828733 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb4255-06e9-46d7-bb7f-1de9fe9bfa18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:00.830180 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbb4255-06e9-46d7-bb7f-1de9fe9bfa18 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:00.839789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1417/2795] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:03.965954 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1fb9-bad3-4a58-94f8-7f7f73ed3b4a service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:03.985153 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef1fb9-bad3-4a58-94f8-7f7f73ed3b4a service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:03.992215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92006d8d-a6aa-4b7c-b85d-2cd621e5590b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:03.993082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92006d8d-a6aa-4b7c-b85d-2cd621e5590b service placement] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:03.993465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92006d8d-a6aa-4b7c-b85d-2cd621e5590b service placement] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:03.993834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92006d8d-a6aa-4b7c-b85d-2cd621e5590b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:03.995806 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-92006d8d-a6aa-4b7c-b85d-2cd621e5590b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:04.008789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92006d8d-a6aa-4b7c-b85d-2cd621e5590b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:04.010528 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92006d8d-a6aa-4b7c-b85d-2cd621e5590b service placement] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:04.024797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1379/2796] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:04.032534 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb4255-06e9-46d7-bb7f-1de9fe9bfa18 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:04.034555 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ecbb4255-06e9-46d7-bb7f-1de9fe9bfa18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:04.049431 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbb4255-06e9-46d7-bb7f-1de9fe9bfa18 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:04.054298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:04.055422 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.055713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.056246 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] PATH_INFO: `/v3/users/eeba43224b9240f8b0dfbf9c47a234e4` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.057459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeba43224b9240f8b0dfbf9c47a234e4)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:04.059461 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:04.114553 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeba43224b9240f8b0dfbf9c47a234e4'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:04.115270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeba43224b9240f8b0dfbf9c47a234e4'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:04.115886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeba43224b9240f8b0dfbf9c47a234e4'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:04.123944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeba43224b9240f8b0dfbf9c47a234e4'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:04.132346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-f778e60e-4654-4388-8095-403a8a7f737f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeba43224b9240f8b0dfbf9c47a234e4'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:04.152101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1418/2797] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:31:04 2022] DELETE /identity/v3/users/eeba43224b9240f8b0dfbf9c47a234e4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:04.353715 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92006d8d-a6aa-4b7c-b85d-2cd621e5590b service placement] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:04.366729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92006d8d-a6aa-4b7c-b85d-2cd621e5590b service placement] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:04.438872 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:04.440585 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.445388 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.445904 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] PATH_INFO: `/v3/projects/38b2bf3d833645fa9314ec5277474ac0` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.447550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38b2bf3d833645fa9314ec5277474ac0)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:04.449481 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:04.500833 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38b2bf3d833645fa9314ec5277474ac0', 'request_id': 'req-e7c9a7c4-9d06-41af-a29e-b1452281a068'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:04.509303 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38b2bf3d833645fa9314ec5277474ac0', 'request_id': 'req-e7c9a7c4-9d06-41af-a29e-b1452281a068'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:04.517127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38b2bf3d833645fa9314ec5277474ac0', 'request_id': 'req-e7c9a7c4-9d06-41af-a29e-b1452281a068'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:04.530163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] The token cache is being invalidate because project 38b2bf3d833645fa9314ec5277474ac0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:31:04.530452 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:04.531157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e7c9a7c4-9d06-41af-a29e-b1452281a068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:04.532712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1380/2798] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:31:04 2022] DELETE /identity/v3/projects/38b2bf3d833645fa9314ec5277474ac0 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:04.537769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a85fe-e17a-41ea-94ca-e47f3a604203 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.538062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a85fe-e17a-41ea-94ca-e47f3a604203 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.538343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a85fe-e17a-41ea-94ca-e47f3a604203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.557005 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e01a85fe-e17a-41ea-94ca-e47f3a604203 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:04.558208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e01a85fe-e17a-41ea-94ca-e47f3a604203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:04.620290 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1419/2799] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:04.628667 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430316b-230e-45fa-a10b-41badc507c95 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.628986 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430316b-230e-45fa-a10b-41badc507c95 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.629272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5430316b-230e-45fa-a10b-41badc507c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.647487 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-5430316b-230e-45fa-a10b-41badc507c95 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:04.648708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5430316b-230e-45fa-a10b-41badc507c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:04.657219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1381/2800] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:04.661387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a85fe-e17a-41ea-94ca-e47f3a604203 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:04.671752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a85fe-e17a-41ea-94ca-e47f3a604203 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:04.676310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a52f1e-75c3-4d1d-8e5b-75cde570aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:04.676973 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52f1e-75c3-4d1d-8e5b-75cde570aa9e admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.677258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52f1e-75c3-4d1d-8e5b-75cde570aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.677542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a52f1e-75c3-4d1d-8e5b-75cde570aa9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.678273 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a52f1e-75c3-4d1d-8e5b-75cde570aa9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:31:04.678587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a52f1e-75c3-4d1d-8e5b-75cde570aa9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:04.680252 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a52f1e-75c3-4d1d-8e5b-75cde570aa9e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:04.681963 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:04.694510 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1420/2801] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:31:04.698665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430316b-230e-45fa-a10b-41badc507c95 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:04.708198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5430316b-230e-45fa-a10b-41badc507c95 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:04.713029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a8c7d-c8d7-4276-9788-50ebdf02eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:04.713690 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a8c7d-c8d7-4276-9788-50ebdf02eee5 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.713975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a8c7d-c8d7-4276-9788-50ebdf02eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.714254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a8c7d-c8d7-4276-9788-50ebdf02eee5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.714975 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a8c7d-c8d7-4276-9788-50ebdf02eee5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:04.718100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a8c7d-c8d7-4276-9788-50ebdf02eee5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:04.744082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1382/2802] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:31:04 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:31:04.748320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a52f1e-75c3-4d1d-8e5b-75cde570aa9e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:04.758229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a52f1e-75c3-4d1d-8e5b-75cde570aa9e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:04.815641 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86be8b9-0e0c-411e-ae1a-63e92789d425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:04.816303 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be8b9-0e0c-411e-ae1a-63e92789d425 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.816585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be8b9-0e0c-411e-ae1a-63e92789d425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.816859 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86be8b9-0e0c-411e-ae1a-63e92789d425 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.817539 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86be8b9-0e0c-411e-ae1a-63e92789d425 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:04.819496 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86be8b9-0e0c-411e-ae1a-63e92789d425 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:04.840918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1421/2803] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:31:04 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:31:04.845635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a8c7d-c8d7-4276-9788-50ebdf02eee5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:04.855746 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a8c7d-c8d7-4276-9788-50ebdf02eee5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:04.860338 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712cce0-047a-4a3d-9f7c-d928d35f774b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:04.860991 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712cce0-047a-4a3d-9f7c-d928d35f774b admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.861275 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712cce0-047a-4a3d-9f7c-d928d35f774b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.861549 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e712cce0-047a-4a3d-9f7c-d928d35f774b admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.862344 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712cce0-047a-4a3d-9f7c-d928d35f774b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:04.864194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e712cce0-047a-4a3d-9f7c-d928d35f774b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:04.875668 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1383/2804] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:31:04.879716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86be8b9-0e0c-411e-ae1a-63e92789d425 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:04.890363 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86be8b9-0e0c-411e-ae1a-63e92789d425 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:04.894999 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77edb74-fd93-4f47-99c7-7213e168369a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:04.895660 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77edb74-fd93-4f47-99c7-7213e168369a admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.895950 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77edb74-fd93-4f47-99c7-7213e168369a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.896236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77edb74-fd93-4f47-99c7-7213e168369a admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.896964 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77edb74-fd93-4f47-99c7-7213e168369a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:04.898584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77edb74-fd93-4f47-99c7-7213e168369a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:04.908931 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1422/2805] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:31:04.913000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712cce0-047a-4a3d-9f7c-d928d35f774b admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:04.923619 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e712cce0-047a-4a3d-9f7c-d928d35f774b admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:04.928251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebba6e1-c64e-4dd5-9248-80bf84799c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:04.929119 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebba6e1-c64e-4dd5-9248-80bf84799c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.929403 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebba6e1-c64e-4dd5-9248-80bf84799c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.929683 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebba6e1-c64e-4dd5-9248-80bf84799c3b admin admin] PATH_INFO: `/v3/projects/fb67d04206a14e35bb1f4737f4edbaac/users/15346c25842e41e0afa5ab7ee53cdb0c/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.944807 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebba6e1-c64e-4dd5-9248-80bf84799c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb67d04206a14e35bb1f4737f4edbaac, user_id=15346c25842e41e0afa5ab7ee53cdb0c, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:04.947420 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebba6e1-c64e-4dd5-9248-80bf84799c3b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:04.959887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1384/2806] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:31:04 2022] PUT /identity/v3/projects/fb67d04206a14e35bb1f4737f4edbaac/users/15346c25842e41e0afa5ab7ee53cdb0c/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:04.970190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4358c33-811b-4a74-86e5-9151aa36a4aa None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:04.970480 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4358c33-811b-4a74-86e5-9151aa36a4aa None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:04.970779 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4358c33-811b-4a74-86e5-9151aa36a4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:04.997046 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a4358c33-811b-4a74-86e5-9151aa36a4aa None None] MFA Rules not processed for user `15346c25842e41e0afa5ab7ee53cdb0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:04.998854 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a4358c33-811b-4a74-86e5-9151aa36a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:05.063148 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1423/2807] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:05.067694 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebba6e1-c64e-4dd5-9248-80bf84799c3b admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:05.081129 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:05.132285 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebba6e1-c64e-4dd5-9248-80bf84799c3b admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:05.136886 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701a58c-1bdc-4fb8-8e36-b8e649f8498f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:05.137536 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701a58c-1bdc-4fb8-8e36-b8e649f8498f admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:05.137821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701a58c-1bdc-4fb8-8e36-b8e649f8498f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:05.138305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2701a58c-1bdc-4fb8-8e36-b8e649f8498f admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:05.139166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701a58c-1bdc-4fb8-8e36-b8e649f8498f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:05.141096 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2701a58c-1bdc-4fb8-8e36-b8e649f8498f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:05.169168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1385/2808] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:31:05 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:31:05.171078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4358c33-811b-4a74-86e5-9151aa36a4aa None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:05.181902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4358c33-811b-4a74-86e5-9151aa36a4aa None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:05.238846 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4c47b-c9e9-4c0e-beed-0b910e6bcac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:05.239462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4c47b-c9e9-4c0e-beed-0b910e6bcac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:05.239744 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4c47b-c9e9-4c0e-beed-0b910e6bcac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:05.240020 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c4c47b-c9e9-4c0e-beed-0b910e6bcac5 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:05.240697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4c47b-c9e9-4c0e-beed-0b910e6bcac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:05.242619 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c4c47b-c9e9-4c0e-beed-0b910e6bcac5 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:05.250494 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:05.262717 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1424/2809] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:31:05 2022] POST /identity/v3/users => generated 299 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:31:05.267019 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701a58c-1bdc-4fb8-8e36-b8e649f8498f admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:05.277416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2701a58c-1bdc-4fb8-8e36-b8e649f8498f admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:05.282545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39ac71-56a8-4405-81fd-bbd90d292a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:05.283257 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39ac71-56a8-4405-81fd-bbd90d292a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:05.283541 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39ac71-56a8-4405-81fd-bbd90d292a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:05.283815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39ac71-56a8-4405-81fd-bbd90d292a8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:05.284539 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39ac71-56a8-4405-81fd-bbd90d292a8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:05.286138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39ac71-56a8-4405-81fd-bbd90d292a8f admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:05.297289 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1386/2810] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:31:05.301260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4c47b-c9e9-4c0e-beed-0b910e6bcac5 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:05.312133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c4c47b-c9e9-4c0e-beed-0b910e6bcac5 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:05.316808 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21a50-754a-4671-b084-d0cb285abe73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:05.317680 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21a50-754a-4671-b084-d0cb285abe73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:05.317970 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21a50-754a-4671-b084-d0cb285abe73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:05.318253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21a50-754a-4671-b084-d0cb285abe73 admin admin] PATH_INFO: `/v3/projects/130c75c182974a369bf75287b4bb5a46/users/9ca954e214104210b7fff8e012dc230c/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:05.332658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21a50-754a-4671-b084-d0cb285abe73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=130c75c182974a369bf75287b4bb5a46, user_id=9ca954e214104210b7fff8e012dc230c, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:05.335371 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad21a50-754a-4671-b084-d0cb285abe73 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:05.348352 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1425/2811] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:31:05 2022] PUT /identity/v3/projects/130c75c182974a369bf75287b4bb5a46/users/9ca954e214104210b7fff8e012dc230c/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:05.352186 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39ac71-56a8-4405-81fd-bbd90d292a8f admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:05.362907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39ac71-56a8-4405-81fd-bbd90d292a8f admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:05.418092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18a898-3cca-4436-a6a6-9f857ee824e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:05.418751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a898-3cca-4436-a6a6-9f857ee824e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:05.419066 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a898-3cca-4436-a6a6-9f857ee824e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:05.419349 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a898-3cca-4436-a6a6-9f857ee824e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:05.420665 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a898-3cca-4436-a6a6-9f857ee824e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:05.422281 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a898-3cca-4436-a6a6-9f857ee824e8 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:05.432082 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1387/2812] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:31:05.436561 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21a50-754a-4671-b084-d0cb285abe73 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:05.447092 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21a50-754a-4671-b084-d0cb285abe73 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:05.451805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0958d-f787-47f6-bf3f-3967c950a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:05.452676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0958d-f787-47f6-bf3f-3967c950a15f admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:05.452955 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0958d-f787-47f6-bf3f-3967c950a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:05.453228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0958d-f787-47f6-bf3f-3967c950a15f admin admin] PATH_INFO: `/v3/projects/130c75c182974a369bf75287b4bb5a46/users/9ca954e214104210b7fff8e012dc230c/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:05.455225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0958d-f787-47f6-bf3f-3967c950a15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=130c75c182974a369bf75287b4bb5a46, user_id=9ca954e214104210b7fff8e012dc230c, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:05.457878 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0958d-f787-47f6-bf3f-3967c950a15f admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:05.468586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1426/2813] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:31:05 2022] PUT /identity/v3/projects/130c75c182974a369bf75287b4bb5a46/users/9ca954e214104210b7fff8e012dc230c/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:31:05.478734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4054f6-2708-45e3-aeee-a316276b14f2 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:05.479053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4054f6-2708-45e3-aeee-a316276b14f2 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:05.479331 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4054f6-2708-45e3-aeee-a316276b14f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:05.505952 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-5c4054f6-2708-45e3-aeee-a316276b14f2 None None] MFA Rules not processed for user `9ca954e214104210b7fff8e012dc230c`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:05.507117 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5c4054f6-2708-45e3-aeee-a316276b14f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:05.574745 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1388/2814] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:05.585538 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0958d-f787-47f6-bf3f-3967c950a15f admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:05.587317 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2de0958d-f787-47f6-bf3f-3967c950a15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:05.644951 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0958d-f787-47f6-bf3f-3967c950a15f admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:05.648503 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef9d25e-7314-472a-b762-9672a992cfb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:05.649136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9d25e-7314-472a-b762-9672a992cfb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:05.649412 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9d25e-7314-472a-b762-9672a992cfb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:05.649685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef9d25e-7314-472a-b762-9672a992cfb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:05.658898 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9d25e-7314-472a-b762-9672a992cfb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:05.660384 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef9d25e-7314-472a-b762-9672a992cfb2 service cinder] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:05.670527 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1427/2815] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:06.234395 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4054f6-2708-45e3-aeee-a316276b14f2 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:06.243974 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:06.297669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4054f6-2708-45e3-aeee-a316276b14f2 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:06.302055 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:06.302914 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:06.303216 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:06.303490 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] PATH_INFO: `/v3/users/15346c25842e41e0afa5ab7ee53cdb0c` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:06.304689 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15346c25842e41e0afa5ab7ee53cdb0c)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:06.306874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:06.353209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15346c25842e41e0afa5ab7ee53cdb0c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:06.353858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15346c25842e41e0afa5ab7ee53cdb0c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:06.354465 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15346c25842e41e0afa5ab7ee53cdb0c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:06.362757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15346c25842e41e0afa5ab7ee53cdb0c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:06.370113 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15346c25842e41e0afa5ab7ee53cdb0c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:06.388556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1389/2816] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:31:06 2022] DELETE /identity/v3/users/15346c25842e41e0afa5ab7ee53cdb0c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:06.393053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab942e-92d5-4884-a9f7-46ed038ab8a8 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:06.393531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab942e-92d5-4884-a9f7-46ed038ab8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:06.393634 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ab942e-92d5-4884-a9f7-46ed038ab8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:06.411566 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-23ab942e-92d5-4884-a9f7-46ed038ab8a8 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:06.412768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-23ab942e-92d5-4884-a9f7-46ed038ab8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:06.472098 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1428/2817] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:06.481904 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:06.483386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:06.539548 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d01d4-4ef7-4d24-8973-1bcd110fbe72 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:06.543211 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81fd11-a672-4533-ac2a-76123c85c67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:06.543844 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81fd11-a672-4533-ac2a-76123c85c67e service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:06.544126 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81fd11-a672-4533-ac2a-76123c85c67e service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:06.544439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81fd11-a672-4533-ac2a-76123c85c67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:06.553351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81fd11-a672-4533-ac2a-76123c85c67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:06.554708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81fd11-a672-4533-ac2a-76123c85c67e service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:06.564418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1390/2818] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:31:06.829825 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab942e-92d5-4884-a9f7-46ed038ab8a8 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:06.831395 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-23ab942e-92d5-4884-a9f7-46ed038ab8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:06.845001 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ab942e-92d5-4884-a9f7-46ed038ab8a8 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:06.849775 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:06.850712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:06.851021 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:06.851376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] PATH_INFO: `/v3/projects/fb67d04206a14e35bb1f4737f4edbaac` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:06.852819 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb67d04206a14e35bb1f4737f4edbaac)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:06.854807 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:06.901725 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb67d04206a14e35bb1f4737f4edbaac', 'request_id': 'req-de522669-9d7b-4aca-8e37-6a565da40bd4'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:06.904331 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:INSERT=5,keystone:SELECT=91,keystone:DELETE=4 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:06.909836 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb67d04206a14e35bb1f4737f4edbaac', 'request_id': 'req-de522669-9d7b-4aca-8e37-6a565da40bd4'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:06.915914 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb67d04206a14e35bb1f4737f4edbaac', 'request_id': 'req-de522669-9d7b-4aca-8e37-6a565da40bd4'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:06.926982 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] The token cache is being invalidate because project fb67d04206a14e35bb1f4737f4edbaac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:31:06.927275 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:06.927911 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:06.929425 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1429/2819] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:31:06 2022] DELETE /identity/v3/projects/fb67d04206a14e35bb1f4737f4edbaac => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:06.933653 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81fd11-a672-4533-ac2a-76123c85c67e service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:06.943862 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81fd11-a672-4533-ac2a-76123c85c67e service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:06.972987 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:07.005171 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:07.006189 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.006581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.006895 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] PATH_INFO: `/v3/users/9ca954e214104210b7fff8e012dc230c` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.008192 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca954e214104210b7fff8e012dc230c)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:07.010158 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:07.057287 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca954e214104210b7fff8e012dc230c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:07.057941 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca954e214104210b7fff8e012dc230c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:07.058540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca954e214104210b7fff8e012dc230c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:07.065829 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca954e214104210b7fff8e012dc230c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:07.072293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-324f0ccb-a7a2-470f-8cf3-d9eab346ad5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca954e214104210b7fff8e012dc230c'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:07.089792 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1391/2820] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:31:06 2022] DELETE /identity/v3/users/9ca954e214104210b7fff8e012dc230c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:07.359346 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:07.360769 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:07.374134 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de522669-9d7b-4aca-8e37-6a565da40bd4 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:07.444284 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:07.445144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.445424 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.445699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] PATH_INFO: `/v3/projects/130c75c182974a369bf75287b4bb5a46` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.446868 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=130c75c182974a369bf75287b4bb5a46)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:07.448806 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:07.494637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130c75c182974a369bf75287b4bb5a46', 'request_id': 'req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:07.501860 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130c75c182974a369bf75287b4bb5a46', 'request_id': 'req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:07.507372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130c75c182974a369bf75287b4bb5a46', 'request_id': 'req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:07.518984 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] The token cache is being invalidate because project 130c75c182974a369bf75287b4bb5a46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:31:07.519289 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:07.519961 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-47b6b2cb-dc9d-4458-b3b0-0bda97d7cecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:07.521491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1430/2821] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:31:07 2022] DELETE /identity/v3/projects/130c75c182974a369bf75287b4bb5a46 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:07.526276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b5981-12ae-4bf7-bd47-395a895006d3 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.526749 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b5981-12ae-4bf7-bd47-395a895006d3 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.526870 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b5981-12ae-4bf7-bd47-395a895006d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.545578 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-f12b5981-12ae-4bf7-bd47-395a895006d3 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:07.546788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f12b5981-12ae-4bf7-bd47-395a895006d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:07.606114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1392/2822] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:07.614995 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2690dc-4dc8-4dd0-96f5-8afc3045d7b2 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.615294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2690dc-4dc8-4dd0-96f5-8afc3045d7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.615579 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2690dc-4dc8-4dd0-96f5-8afc3045d7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.634045 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-ca2690dc-4dc8-4dd0-96f5-8afc3045d7b2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:07.635272 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-ca2690dc-4dc8-4dd0-96f5-8afc3045d7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:07.643756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1431/2823] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:07.647915 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b5981-12ae-4bf7-bd47-395a895006d3 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:07.657751 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b5981-12ae-4bf7-bd47-395a895006d3 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:07.662318 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855769-853f-4055-ab84-50d129363f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:07.662980 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855769-853f-4055-ab84-50d129363f4e admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.663273 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855769-853f-4055-ab84-50d129363f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.663550 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7855769-853f-4055-ab84-50d129363f4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.664268 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7855769-853f-4055-ab84-50d129363f4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80606) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:31:07.664600 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7855769-853f-4055-ab84-50d129363f4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:07.666196 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7855769-853f-4055-ab84-50d129363f4e admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:07.677902 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1393/2824] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:31:07.682501 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2690dc-4dc8-4dd0-96f5-8afc3045d7b2 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:07.692514 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2690dc-4dc8-4dd0-96f5-8afc3045d7b2 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:07.697114 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94412915-3086-41a9-8f96-0927c5e4a94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:07.697758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94412915-3086-41a9-8f96-0927c5e4a94c admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.698039 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94412915-3086-41a9-8f96-0927c5e4a94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.698315 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94412915-3086-41a9-8f96-0927c5e4a94c admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.699058 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94412915-3086-41a9-8f96-0927c5e4a94c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:07.701753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94412915-3086-41a9-8f96-0927c5e4a94c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:07.727212 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1432/2825] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:31:07 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:31:07.731569 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855769-853f-4055-ab84-50d129363f4e admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:07.741814 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7855769-853f-4055-ab84-50d129363f4e admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:07.775923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:07.801555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f428ad-c34e-4c77-97d1-81e4133ac1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:07.802222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f428ad-c34e-4c77-97d1-81e4133ac1e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.802516 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f428ad-c34e-4c77-97d1-81e4133ac1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.802795 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f428ad-c34e-4c77-97d1-81e4133ac1e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.803531 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f428ad-c34e-4c77-97d1-81e4133ac1e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:07.805474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f428ad-c34e-4c77-97d1-81e4133ac1e2 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:07.825219 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1394/2826] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:31:07 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:31:07.830014 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94412915-3086-41a9-8f96-0927c5e4a94c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:07.840120 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94412915-3086-41a9-8f96-0927c5e4a94c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:07.844829 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebcb69-cddf-4cfc-bbf6-ec33acb49171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:07.845478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebcb69-cddf-4cfc-bbf6-ec33acb49171 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.845763 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebcb69-cddf-4cfc-bbf6-ec33acb49171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.846040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ebcb69-cddf-4cfc-bbf6-ec33acb49171 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.846787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebcb69-cddf-4cfc-bbf6-ec33acb49171 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:07.848428 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ebcb69-cddf-4cfc-bbf6-ec33acb49171 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:07.858789 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1433/2827] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:31:07.862443 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f428ad-c34e-4c77-97d1-81e4133ac1e2 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:07.873127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f428ad-c34e-4c77-97d1-81e4133ac1e2 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:07.878221 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f896e9f-f966-4500-91cc-d3c55681994d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:07.878883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f896e9f-f966-4500-91cc-d3c55681994d admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.879203 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f896e9f-f966-4500-91cc-d3c55681994d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.879484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f896e9f-f966-4500-91cc-d3c55681994d admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.880210 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f896e9f-f966-4500-91cc-d3c55681994d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:07.881813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f896e9f-f966-4500-91cc-d3c55681994d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:07.892462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1395/2828] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:31:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:31:07.896491 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebcb69-cddf-4cfc-bbf6-ec33acb49171 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:07.906846 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ebcb69-cddf-4cfc-bbf6-ec33acb49171 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:07.911453 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50921e8-2ee3-498d-a4aa-82599e9893ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:07.912324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50921e8-2ee3-498d-a4aa-82599e9893ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.912606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50921e8-2ee3-498d-a4aa-82599e9893ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.912882 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50921e8-2ee3-498d-a4aa-82599e9893ea admin admin] PATH_INFO: `/v3/projects/b6f9cb5587b34f609352f243c75f4a7f/users/76e40b3549404f4b9efee18f5bd020ca/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.927909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50921e8-2ee3-498d-a4aa-82599e9893ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6f9cb5587b34f609352f243c75f4a7f, user_id=76e40b3549404f4b9efee18f5bd020ca, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:07.930567 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50921e8-2ee3-498d-a4aa-82599e9893ea admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:07.943948 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1434/2829] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:31:07 2022] PUT /identity/v3/projects/b6f9cb5587b34f609352f243c75f4a7f/users/76e40b3549404f4b9efee18f5bd020ca/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:07.954053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e70481-3684-4c2e-af39-f2a7455322e1 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:07.954378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e70481-3684-4c2e-af39-f2a7455322e1 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:07.954663 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e70481-3684-4c2e-af39-f2a7455322e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:07.980851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-47e70481-3684-4c2e-af39-f2a7455322e1 None None] MFA Rules not processed for user `76e40b3549404f4b9efee18f5bd020ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:07.982741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-47e70481-3684-4c2e-af39-f2a7455322e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:08.048091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1396/2830] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:08.052600 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50921e8-2ee3-498d-a4aa-82599e9893ea admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:08.062392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:08.115452 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50921e8-2ee3-498d-a4aa-82599e9893ea admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:08.119939 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835edbce-fd9d-408a-a5bd-ad20a85d695a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:08.120593 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835edbce-fd9d-408a-a5bd-ad20a85d695a admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:08.120896 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835edbce-fd9d-408a-a5bd-ad20a85d695a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:08.121157 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835edbce-fd9d-408a-a5bd-ad20a85d695a admin admin] PATH_INFO: `/v3/projects` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:08.121843 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835edbce-fd9d-408a-a5bd-ad20a85d695a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:08.124584 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835edbce-fd9d-408a-a5bd-ad20a85d695a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:08.149647 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1435/2831] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:31:08 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:31:08.153720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e70481-3684-4c2e-af39-f2a7455322e1 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:08.164835 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e70481-3684-4c2e-af39-f2a7455322e1 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:08.221373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1827fc-c50d-49b7-9cca-144f82510fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:08.222044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1827fc-c50d-49b7-9cca-144f82510fce admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:08.222326 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1827fc-c50d-49b7-9cca-144f82510fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:08.222601 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1827fc-c50d-49b7-9cca-144f82510fce admin admin] PATH_INFO: `/v3/users` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:08.223319 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1827fc-c50d-49b7-9cca-144f82510fce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:08.225230 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1827fc-c50d-49b7-9cca-144f82510fce admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:08.244050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1397/2832] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:31:08 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:31:08.247988 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835edbce-fd9d-408a-a5bd-ad20a85d695a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:08.258238 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835edbce-fd9d-408a-a5bd-ad20a85d695a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:08.262853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f75b8-40c0-4a40-b8e6-759eff2f2d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:08.264074 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f75b8-40c0-4a40-b8e6-759eff2f2d4a admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:08.264310 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f75b8-40c0-4a40-b8e6-759eff2f2d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:08.264587 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f75b8-40c0-4a40-b8e6-759eff2f2d4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:08.265305 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f75b8-40c0-4a40-b8e6-759eff2f2d4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:08.266920 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f75b8-40c0-4a40-b8e6-759eff2f2d4a admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:08.278334 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1436/2833] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:31:08.282587 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1827fc-c50d-49b7-9cca-144f82510fce admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:08.292384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1827fc-c50d-49b7-9cca-144f82510fce admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:08.297770 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b55789-8f33-4dba-986b-eb23c72d509a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:08.298633 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b55789-8f33-4dba-986b-eb23c72d509a admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:08.298916 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b55789-8f33-4dba-986b-eb23c72d509a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:08.299222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b55789-8f33-4dba-986b-eb23c72d509a admin admin] PATH_INFO: `/v3/projects/71bf843af8254952a090b0f823372ff8/users/f57a05cdd58e4b958f68d0e6324d8d3a/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:08.314605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b55789-8f33-4dba-986b-eb23c72d509a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bf843af8254952a090b0f823372ff8, user_id=f57a05cdd58e4b958f68d0e6324d8d3a, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:08.317270 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b55789-8f33-4dba-986b-eb23c72d509a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:08.329750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1398/2834] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:31:08 2022] PUT /identity/v3/projects/71bf843af8254952a090b0f823372ff8/users/f57a05cdd58e4b958f68d0e6324d8d3a/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:08.333575 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f75b8-40c0-4a40-b8e6-759eff2f2d4a admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:08.344468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f75b8-40c0-4a40-b8e6-759eff2f2d4a admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:08.400299 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c6ac1-1c43-4763-a863-44852360af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:08.400890 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c6ac1-1c43-4763-a863-44852360af68 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:08.401174 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c6ac1-1c43-4763-a863-44852360af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:08.401460 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c6ac1-1c43-4763-a863-44852360af68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:08.402201 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c6ac1-1c43-4763-a863-44852360af68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:08.403846 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67c6ac1-1c43-4763-a863-44852360af68 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:08.414459 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1437/2835] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:31:08.418750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b55789-8f33-4dba-986b-eb23c72d509a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:08.429500 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b55789-8f33-4dba-986b-eb23c72d509a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:08.434304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446ceb4-9d79-474d-ba79-2499dbf7224a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:08.435206 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446ceb4-9d79-474d-ba79-2499dbf7224a admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:08.435489 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446ceb4-9d79-474d-ba79-2499dbf7224a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:08.435760 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446ceb4-9d79-474d-ba79-2499dbf7224a admin admin] PATH_INFO: `/v3/projects/71bf843af8254952a090b0f823372ff8/users/f57a05cdd58e4b958f68d0e6324d8d3a/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:08.437719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446ceb4-9d79-474d-ba79-2499dbf7224a admin admin] RBAC: Authorizing `identity:create_grant(project_id=71bf843af8254952a090b0f823372ff8, user_id=f57a05cdd58e4b958f68d0e6324d8d3a, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:08.440399 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446ceb4-9d79-474d-ba79-2499dbf7224a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:08.445741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:08.452628 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1399/2836] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:31:08 2022] PUT /identity/v3/projects/71bf843af8254952a090b0f823372ff8/users/f57a05cdd58e4b958f68d0e6324d8d3a/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:08.462697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02b79-c73c-4a6e-becd-7207212eccdc None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:08.463216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02b79-c73c-4a6e-becd-7207212eccdc None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:08.463333 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c02b79-c73c-4a6e-becd-7207212eccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:08.492590 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-23c02b79-c73c-4a6e-becd-7207212eccdc None None] MFA Rules not processed for user `f57a05cdd58e4b958f68d0e6324d8d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:08.493794 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-23c02b79-c73c-4a6e-becd-7207212eccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:08.561508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1438/2837] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:08.572053 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446ceb4-9d79-474d-ba79-2499dbf7224a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:08.573797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-e446ceb4-9d79-474d-ba79-2499dbf7224a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:08.639148 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446ceb4-9d79-474d-ba79-2499dbf7224a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:08.642820 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca526df-9357-4775-99a9-c2d7746885bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:08.643502 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca526df-9357-4775-99a9-c2d7746885bb service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:08.643790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca526df-9357-4775-99a9-c2d7746885bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:08.645808 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca526df-9357-4775-99a9-c2d7746885bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:08.656702 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca526df-9357-4775-99a9-c2d7746885bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:08.658083 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca526df-9357-4775-99a9-c2d7746885bb service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:08.667535 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1400/2838] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:09.020851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02b79-c73c-4a6e-becd-7207212eccdc None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:09.025061 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:09.084028 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c02b79-c73c-4a6e-becd-7207212eccdc None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:09.088462 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:09.089323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:09.089606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:09.089912 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] PATH_INFO: `/v3/users/76e40b3549404f4b9efee18f5bd020ca` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:09.091113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e40b3549404f4b9efee18f5bd020ca)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:09.093522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:09.137556 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e40b3549404f4b9efee18f5bd020ca'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.138200 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e40b3549404f4b9efee18f5bd020ca'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.138821 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e40b3549404f4b9efee18f5bd020ca'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.146113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e40b3549404f4b9efee18f5bd020ca'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.153044 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e40b3549404f4b9efee18f5bd020ca'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.172359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1439/2839] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:31:09 2022] DELETE /identity/v3/users/76e40b3549404f4b9efee18f5bd020ca => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:09.176851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8dc36-38ec-40cc-8895-10a8b6d6362e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:09.177139 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8dc36-38ec-40cc-8895-10a8b6d6362e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:09.177418 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d8dc36-38ec-40cc-8895-10a8b6d6362e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:09.195256 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-14d8dc36-38ec-40cc-8895-10a8b6d6362e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:09.196477 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-14d8dc36-38ec-40cc-8895-10a8b6d6362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:09.254620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1401/2840] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:31:09.264661 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:09.266051 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:09.322899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e741d-5ca0-46ed-9bed-f21f98f2b73c admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:09.327164 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c2887-2d08-4514-b972-c7860ac53c11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:09.327883 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c2887-2d08-4514-b972-c7860ac53c11 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:09.328219 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c2887-2d08-4514-b972-c7860ac53c11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:09.328532 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39c2887-2d08-4514-b972-c7860ac53c11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:09.338430 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c2887-2d08-4514-b972-c7860ac53c11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:09.339923 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39c2887-2d08-4514-b972-c7860ac53c11 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:09.350048 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1440/2841] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:09.615226 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8dc36-38ec-40cc-8895-10a8b6d6362e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:09.616678 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-14d8dc36-38ec-40cc-8895-10a8b6d6362e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:09.628711 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d8dc36-38ec-40cc-8895-10a8b6d6362e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:09.633294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:09.634157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:09.634442 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:09.634720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] PATH_INFO: `/v3/projects/b6f9cb5587b34f609352f243c75f4a7f` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:09.635940 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6f9cb5587b34f609352f243c75f4a7f)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:09.637986 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:09.686852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6f9cb5587b34f609352f243c75f4a7f', 'request_id': 'req-bb43bc99-eee0-4857-957f-20e0285d44b5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.693484 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6f9cb5587b34f609352f243c75f4a7f', 'request_id': 'req-bb43bc99-eee0-4857-957f-20e0285d44b5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.698922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6f9cb5587b34f609352f243c75f4a7f', 'request_id': 'req-bb43bc99-eee0-4857-957f-20e0285d44b5'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.710486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] The token cache is being invalidate because project b6f9cb5587b34f609352f243c75f4a7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:31:09.710773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.711435 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.712994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1402/2842] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:31:09 2022] DELETE /identity/v3/projects/b6f9cb5587b34f609352f243c75f4a7f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:09.716962 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c2887-2d08-4514-b972-c7860ac53c11 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:09.727260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39c2887-2d08-4514-b972-c7860ac53c11 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:09.746677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:09.787049 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:09.787913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:09.788192 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:09.788468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] PATH_INFO: `/v3/users/f57a05cdd58e4b958f68d0e6324d8d3a` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:09.789768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f57a05cdd58e4b958f68d0e6324d8d3a)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:09.792024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:09.836142 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f57a05cdd58e4b958f68d0e6324d8d3a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.836783 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f57a05cdd58e4b958f68d0e6324d8d3a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.837391 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f57a05cdd58e4b958f68d0e6324d8d3a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.844104 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f57a05cdd58e4b958f68d0e6324d8d3a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.851022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-c151cce4-387e-4756-8e45-84d75d685464 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f57a05cdd58e4b958f68d0e6324d8d3a'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:09.867715 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1441/2843] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:31:09 2022] DELETE /identity/v3/users/f57a05cdd58e4b958f68d0e6324d8d3a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:10.136664 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:10.138102 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:10.153729 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43bc99-eee0-4857-957f-20e0285d44b5 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:10.176919 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:10.216330 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:10.217215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.217791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.217791 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] PATH_INFO: `/v3/projects/71bf843af8254952a090b0f823372ff8` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.218973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] RBAC: Authorizing `identity:delete_project(project_id=71bf843af8254952a090b0f823372ff8)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:10.221010 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:10.266278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71bf843af8254952a090b0f823372ff8', 'request_id': 'req-7e111f06-ce94-4700-8ac6-41e8e02a176d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:10.273469 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71bf843af8254952a090b0f823372ff8', 'request_id': 'req-7e111f06-ce94-4700-8ac6-41e8e02a176d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:10.279191 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71bf843af8254952a090b0f823372ff8', 'request_id': 'req-7e111f06-ce94-4700-8ac6-41e8e02a176d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:10.290262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] The token cache is being invalidate because project 71bf843af8254952a090b0f823372ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:31:10.290553 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:10.291222 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e111f06-ce94-4700-8ac6-41e8e02a176d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:31:10.292773 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1403/2844] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:31:10 2022] DELETE /identity/v3/projects/71bf843af8254952a090b0f823372ff8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:10.299123 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3863c9a-42b5-4c32-bb19-b83a7e863355 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.299419 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3863c9a-42b5-4c32-bb19-b83a7e863355 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.299702 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3863c9a-42b5-4c32-bb19-b83a7e863355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.317832 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d3863c9a-42b5-4c32-bb19-b83a7e863355 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:10.319068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d3863c9a-42b5-4c32-bb19-b83a7e863355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:10.378191 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1442/2845] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:10.386060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f855-ec07-49ec-9c32-d3c57c9a5349 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.386351 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f855-ec07-49ec-9c32-d3c57c9a5349 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.386661 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe33f855-ec07-49ec-9c32-d3c57c9a5349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.405847 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-fe33f855-ec07-49ec-9c32-d3c57c9a5349 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:10.407071 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-fe33f855-ec07-49ec-9c32-d3c57c9a5349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:10.414834 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1404/2846] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:10.418945 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3863c9a-42b5-4c32-bb19-b83a7e863355 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:10.428767 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3863c9a-42b5-4c32-bb19-b83a7e863355 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:10.433608 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebb140-5f7d-4bc6-8507-bbaa045b4f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:10.434262 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebb140-5f7d-4bc6-8507-bbaa045b4f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.434550 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebb140-5f7d-4bc6-8507-bbaa045b4f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.434834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebb140-5f7d-4bc6-8507-bbaa045b4f97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.435602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebb140-5f7d-4bc6-8507-bbaa045b4f97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:31:10.435943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebb140-5f7d-4bc6-8507-bbaa045b4f97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:10.438777 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebb140-5f7d-4bc6-8507-bbaa045b4f97 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:10.450857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1443/2847] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:31:10.456003 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33f855-ec07-49ec-9c32-d3c57c9a5349 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:10.465643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe33f855-ec07-49ec-9c32-d3c57c9a5349 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:10.471407 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab5d06-ecd6-457f-91f9-48fcd50eb90a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:10.472004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5d06-ecd6-457f-91f9-48fcd50eb90a admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.472291 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5d06-ecd6-457f-91f9-48fcd50eb90a admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.472571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5d06-ecd6-457f-91f9-48fcd50eb90a admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.473265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab5d06-ecd6-457f-91f9-48fcd50eb90a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:10.477152 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aab5d06-ecd6-457f-91f9-48fcd50eb90a admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:10.501730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1405/2848] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:31:10 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:31:10.505861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebb140-5f7d-4bc6-8507-bbaa045b4f97 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:10.516286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebb140-5f7d-4bc6-8507-bbaa045b4f97 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:10.544809 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:10.575372 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ec8b6-b385-4f50-ab08-2269b64a8aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:10.576040 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec8b6-b385-4f50-ab08-2269b64a8aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.576324 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec8b6-b385-4f50-ab08-2269b64a8aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.577276 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ec8b6-b385-4f50-ab08-2269b64a8aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.577965 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ec8b6-b385-4f50-ab08-2269b64a8aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:10.579935 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ec8b6-b385-4f50-ab08-2269b64a8aa8 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:10.599321 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1444/2849] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:31:10 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:31:10.603138 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab5d06-ecd6-457f-91f9-48fcd50eb90a admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:10.613789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab5d06-ecd6-457f-91f9-48fcd50eb90a admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:10.618458 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151c0b2-5a13-4ae2-b2f8-80a498b288e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:10.619140 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151c0b2-5a13-4ae2-b2f8-80a498b288e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.619455 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151c0b2-5a13-4ae2-b2f8-80a498b288e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.619734 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151c0b2-5a13-4ae2-b2f8-80a498b288e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.620496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151c0b2-5a13-4ae2-b2f8-80a498b288e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:10.622107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151c0b2-5a13-4ae2-b2f8-80a498b288e4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:10.633253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1406/2850] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:31:10.637115 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ec8b6-b385-4f50-ab08-2269b64a8aa8 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:10.647686 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ec8b6-b385-4f50-ab08-2269b64a8aa8 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:10.652196 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9da006-32cf-4992-b1f1-c5e4f6b55e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:10.652840 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9da006-32cf-4992-b1f1-c5e4f6b55e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.653121 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9da006-32cf-4992-b1f1-c5e4f6b55e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.653396 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9da006-32cf-4992-b1f1-c5e4f6b55e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.654113 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9da006-32cf-4992-b1f1-c5e4f6b55e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:10.655751 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9da006-32cf-4992-b1f1-c5e4f6b55e58 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:10.666308 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1445/2851] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:31:10.670579 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151c0b2-5a13-4ae2-b2f8-80a498b288e4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:10.680439 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151c0b2-5a13-4ae2-b2f8-80a498b288e4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:10.685253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7ee0b-cd6a-462d-af8e-afcf0519b17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:10.686617 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7ee0b-cd6a-462d-af8e-afcf0519b17d admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.687015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7ee0b-cd6a-462d-af8e-afcf0519b17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.687296 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e7ee0b-cd6a-462d-af8e-afcf0519b17d admin admin] PATH_INFO: `/v3/projects/a8242102238e46c2a92ba1af0810b5a4/users/b055faf6cf3d4f88af4eb57dbafe759d/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.702332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7ee0b-cd6a-462d-af8e-afcf0519b17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8242102238e46c2a92ba1af0810b5a4, user_id=b055faf6cf3d4f88af4eb57dbafe759d, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:10.705063 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e7ee0b-cd6a-462d-af8e-afcf0519b17d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:10.720673 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1407/2852] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:31:10 2022] PUT /identity/v3/projects/a8242102238e46c2a92ba1af0810b5a4/users/b055faf6cf3d4f88af4eb57dbafe759d/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:31:10.725790 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b728743-1663-400e-b43c-dc65ce9d7690 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.726240 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b728743-1663-400e-b43c-dc65ce9d7690 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.726338 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b728743-1663-400e-b43c-dc65ce9d7690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.743107 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-3b728743-1663-400e-b43c-dc65ce9d7690 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:10.744305 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3b728743-1663-400e-b43c-dc65ce9d7690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:10.804267 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1446/2853] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:10.814577 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7ee0b-cd6a-462d-af8e-afcf0519b17d admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:10.816280 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-71e7ee0b-cd6a-462d-af8e-afcf0519b17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:10.871555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e7ee0b-cd6a-462d-af8e-afcf0519b17d admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:10.875910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78722-f5d1-451d-9595-a581381a1e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:10.876551 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78722-f5d1-451d-9595-a581381a1e00 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:10.876837 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78722-f5d1-451d-9595-a581381a1e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:10.877114 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd78722-f5d1-451d-9595-a581381a1e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:10.883059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:10.887441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd78722-f5d1-451d-9595-a581381a1e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:10.889968 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd78722-f5d1-451d-9595-a581381a1e00 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:10.900710 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1408/2854] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:11.520000 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0735d3d-a643-4c92-8972-265cac72e0c2 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:11.520286 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0735d3d-a643-4c92-8972-265cac72e0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:11.520609 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0735d3d-a643-4c92-8972-265cac72e0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:11.549842 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-b0735d3d-a643-4c92-8972-265cac72e0c2 None None] MFA Rules not processed for user `b055faf6cf3d4f88af4eb57dbafe759d`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:11.551087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-b0735d3d-a643-4c92-8972-265cac72e0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:11.624446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1447/2855] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:11.635067 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78722-f5d1-451d-9595-a581381a1e00 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:11.636511 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-8fd78722-f5d1-451d-9595-a581381a1e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:11.695290 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd78722-f5d1-451d-9595-a581381a1e00 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:11.698878 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc50f55-e120-43d1-9bd2-0a261d18872b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:11.699559 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc50f55-e120-43d1-9bd2-0a261d18872b service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:11.699850 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc50f55-e120-43d1-9bd2-0a261d18872b service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:11.700133 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc50f55-e120-43d1-9bd2-0a261d18872b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:11.710168 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc50f55-e120-43d1-9bd2-0a261d18872b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:11.711478 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc50f55-e120-43d1-9bd2-0a261d18872b service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:11.721526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1409/2856] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:13.114724 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8a18-f0df-408f-a5bf-b51fa6a6034c None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:13.115345 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8a18-f0df-408f-a5bf-b51fa6a6034c None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:13.115471 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded8a18-f0df-408f-a5bf-b51fa6a6034c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:13.132909 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-2ded8a18-f0df-408f-a5bf-b51fa6a6034c None None] MFA Rules not processed for user `b055faf6cf3d4f88af4eb57dbafe759d`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:13.134106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2ded8a18-f0df-408f-a5bf-b51fa6a6034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:13.141232 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1448/2857] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:13.382822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc50f55-e120-43d1-9bd2-0a261d18872b service cinder] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:13.392688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc50f55-e120-43d1-9bd2-0a261d18872b service cinder] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:13.396184 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c85b9-9d0b-417a-8199-fd4a8ddc751d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:13.396811 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c85b9-9d0b-417a-8199-fd4a8ddc751d service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:13.397092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c85b9-9d0b-417a-8199-fd4a8ddc751d service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:13.397365 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c85b9-9d0b-417a-8199-fd4a8ddc751d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:13.399163 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0a1c85b9-9d0b-417a-8199-fd4a8ddc751d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:13.410367 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c85b9-9d0b-417a-8199-fd4a8ddc751d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:13.411851 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c85b9-9d0b-417a-8199-fd4a8ddc751d service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:13.420739 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1410/2858] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:23.101263 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded8a18-f0df-408f-a5bf-b51fa6a6034c None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:23.103654 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-2ded8a18-f0df-408f-a5bf-b51fa6a6034c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:23.156053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:23.204630 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded8a18-f0df-408f-a5bf-b51fa6a6034c None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:23.210946 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c3a98-c74e-416d-aa09-0f76aaec8313 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:23.211635 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3a98-c74e-416d-aa09-0f76aaec8313 service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:23.211943 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3a98-c74e-416d-aa09-0f76aaec8313 service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:23.212215 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7c3a98-c74e-416d-aa09-0f76aaec8313 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:23.214071 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fe7c3a98-c74e-416d-aa09-0f76aaec8313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:23.227172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c3a98-c74e-416d-aa09-0f76aaec8313 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:23.228787 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7c3a98-c74e-416d-aa09-0f76aaec8313 service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:23.240758 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1449/2859] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:23.417100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=35 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:29.577348 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd240-94aa-450a-a78b-26eea988ef89 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:29.577964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd240-94aa-450a-a78b-26eea988ef89 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:29.577964 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdd240-94aa-450a-a78b-26eea988ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:29.595312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-2bfdd240-94aa-450a-a78b-26eea988ef89 None None] MFA Rules not processed for user `b055faf6cf3d4f88af4eb57dbafe759d`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:29.596679 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2bfdd240-94aa-450a-a78b-26eea988ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:29.603433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1411/2860] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:31:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:31:29.841008 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c3a98-c74e-416d-aa09-0f76aaec8313 service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:29.842438 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fe7c3a98-c74e-416d-aa09-0f76aaec8313 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:29.854699 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7c3a98-c74e-416d-aa09-0f76aaec8313 service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:29.858319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6c4473-35b3-43ef-9f3f-88e194b2e78f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:29.858972 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c4473-35b3-43ef-9f3f-88e194b2e78f service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:29.859270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c4473-35b3-43ef-9f3f-88e194b2e78f service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:29.859552 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6c4473-35b3-43ef-9f3f-88e194b2e78f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:29.861283 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-3d6c4473-35b3-43ef-9f3f-88e194b2e78f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:29.870645 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c4473-35b3-43ef-9f3f-88e194b2e78f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:29.872109 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6c4473-35b3-43ef-9f3f-88e194b2e78f service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:29.880187 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1450/2861] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:34.655433 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdd240-94aa-450a-a78b-26eea988ef89 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:34.656857 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2bfdd240-94aa-450a-a78b-26eea988ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:34.727101 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdd240-94aa-450a-a78b-26eea988ef89 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:34.732121 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08129321-4eb2-48c0-82b4-74e971e1bf02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:34.732771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08129321-4eb2-48c0-82b4-74e971e1bf02 service placement] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:34.733054 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08129321-4eb2-48c0-82b4-74e971e1bf02 service placement] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:34.733332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08129321-4eb2-48c0-82b4-74e971e1bf02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:34.735157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-08129321-4eb2-48c0-82b4-74e971e1bf02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:34.747059 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08129321-4eb2-48c0-82b4-74e971e1bf02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:34.748669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08129321-4eb2-48c0-82b4-74e971e1bf02 service placement] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:34.759343 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1412/2862] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:31:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:31:39.876616 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=25 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:44.754967 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=35 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:31:50.867139 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062ee44-a43c-4457-b5df-0370d7a676e6 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:50.867602 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062ee44-a43c-4457-b5df-0370d7a676e6 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:50.867698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062ee44-a43c-4457-b5df-0370d7a676e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:50.915367 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-6062ee44-a43c-4457-b5df-0370d7a676e6 None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:31:50.916640 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-6062ee44-a43c-4457-b5df-0370d7a676e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:50.980752 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1451/2863] 10.222.0.48 () {58 vars in 1009 bytes} [Thu Jul 21 04:31:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:31:51.028783 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08129321-4eb2-48c0-82b4-74e971e1bf02 service placement] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:31:51.030236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-08129321-4eb2-48c0-82b4-74e971e1bf02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:31:51.122571 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08129321-4eb2-48c0-82b4-74e971e1bf02 service placement] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:31:51.127721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86763d4-14dd-46f4-8283-ddc656b5b018 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:31:51.128923 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86763d4-14dd-46f4-8283-ddc656b5b018 service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:31:51.129209 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86763d4-14dd-46f4-8283-ddc656b5b018 service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:31:51.129485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86763d4-14dd-46f4-8283-ddc656b5b018 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:31:51.138002 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86763d4-14dd-46f4-8283-ddc656b5b018 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:31:51.139643 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86763d4-14dd-46f4-8283-ddc656b5b018 service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:31:51.147650 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1413/2864] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:31:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 21 04:32:00.978247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=40 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:01.144958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=41 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:06.475563 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2faef4-6cba-4b87-98c7-127dc300a70e None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:06.476022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2faef4-6cba-4b87-98c7-127dc300a70e None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:06.476136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2faef4-6cba-4b87-98c7-127dc300a70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:06.493301 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-dc2faef4-6cba-4b87-98c7-127dc300a70e None None] MFA Rules not processed for user `a9da3c101fd64bb496c7e5512edc9bf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:06.494479 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-dc2faef4-6cba-4b87-98c7-127dc300a70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:06.501506 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1452/2865] 10.222.0.48 () {58 vars in 967 bytes} [Thu Jul 21 04:32:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:06.514185 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86763d4-14dd-46f4-8283-ddc656b5b018 service swift] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:06.525315 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86763d4-14dd-46f4-8283-ddc656b5b018 service swift] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:06.530255 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471b723-428d-4a4c-9fca-d53d59d48fc5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4bfb2a63f46a4a419da65805253ef7ac', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:06.530887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b723-428d-4a4c-9fca-d53d59d48fc5 service swift] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:06.531201 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b723-428d-4a4c-9fca-d53d59d48fc5 service swift] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:06.531506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471b723-428d-4a4c-9fca-d53d59d48fc5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:06.540324 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471b723-428d-4a4c-9fca-d53d59d48fc5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:06.541917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5471b723-428d-4a4c-9fca-d53d59d48fc5 service swift] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:06.549960 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1414/2866] 10.222.0.48 () {60 vars in 1384 bytes} [Thu Jul 21 04:32:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 21 04:32:08.453529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2faef4-6cba-4b87-98c7-127dc300a70e None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:08.465228 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2faef4-6cba-4b87-98c7-127dc300a70e None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:08.469778 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:08.470753 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:08.470947 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:08.471256 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] PATH_INFO: `/v3/users/b055faf6cf3d4f88af4eb57dbafe759d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:08.472542 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b055faf6cf3d4f88af4eb57dbafe759d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:08.475265 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:08.522824 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b055faf6cf3d4f88af4eb57dbafe759d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:08.523519 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b055faf6cf3d4f88af4eb57dbafe759d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:08.524133 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b055faf6cf3d4f88af4eb57dbafe759d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:08.531306 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b055faf6cf3d4f88af4eb57dbafe759d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:08.538456 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8c10b0ca-b39c-4685-abfa-a801fde12d64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b055faf6cf3d4f88af4eb57dbafe759d'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:08.556235 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1453/2867] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:32:08 2022] DELETE /identity/v3/users/b055faf6cf3d4f88af4eb57dbafe759d => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:32:08.731020 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471b723-428d-4a4c-9fca-d53d59d48fc5 service swift] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:08.743730 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471b723-428d-4a4c-9fca-d53d59d48fc5 service swift] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:08.799360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:08.800215 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:08.800499 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:08.801364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] PATH_INFO: `/v3/projects/a8242102238e46c2a92ba1af0810b5a4` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:08.802546 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8242102238e46c2a92ba1af0810b5a4)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:08.804494 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:08.848709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8242102238e46c2a92ba1af0810b5a4', 'request_id': 'req-cfaa3c02-fe17-4384-b0f1-a27f442005de'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:08.855389 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8242102238e46c2a92ba1af0810b5a4', 'request_id': 'req-cfaa3c02-fe17-4384-b0f1-a27f442005de'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:08.860615 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8242102238e46c2a92ba1af0810b5a4', 'request_id': 'req-cfaa3c02-fe17-4384-b0f1-a27f442005de'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:08.871885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] The token cache is being invalidate because project a8242102238e46c2a92ba1af0810b5a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:32:08.872171 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:08.872790 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-cfaa3c02-fe17-4384-b0f1-a27f442005de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:08.874294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1415/2868] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:32:08 2022] DELETE /identity/v3/projects/a8242102238e46c2a92ba1af0810b5a4 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:32:08.879327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3198b43-2516-474e-af73-3fbe581e77ad None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:08.879851 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3198b43-2516-474e-af73-3fbe581e77ad None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:08.880137 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3198b43-2516-474e-af73-3fbe581e77ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:08.897695 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-e3198b43-2516-474e-af73-3fbe581e77ad None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:08.898881 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-e3198b43-2516-474e-af73-3fbe581e77ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:08.956657 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1454/2869] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:08.964697 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3eb60-da9c-4253-a380-ae1865472db2 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:08.965015 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3eb60-da9c-4253-a380-ae1865472db2 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:08.965293 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c3eb60-da9c-4253-a380-ae1865472db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:08.983786 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-39c3eb60-da9c-4253-a380-ae1865472db2 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:08.985001 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-39c3eb60-da9c-4253-a380-ae1865472db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:08.993561 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1416/2870] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:08.997578 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3198b43-2516-474e-af73-3fbe581e77ad None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:09.007145 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3198b43-2516-474e-af73-3fbe581e77ad None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:09.012205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ee13f-5f59-483d-bf2a-15e1dc62d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:09.012852 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee13f-5f59-483d-bf2a-15e1dc62d94e admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:09.013132 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee13f-5f59-483d-bf2a-15e1dc62d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:09.013406 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ee13f-5f59-483d-bf2a-15e1dc62d94e admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:09.014129 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ee13f-5f59-483d-bf2a-15e1dc62d94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:32:09.014434 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ee13f-5f59-483d-bf2a-15e1dc62d94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:09.016069 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ee13f-5f59-483d-bf2a-15e1dc62d94e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:09.027768 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1455/2871] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:32:09.031981 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3eb60-da9c-4253-a380-ae1865472db2 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:09.041858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c3eb60-da9c-4253-a380-ae1865472db2 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:09.046424 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36edf-1683-4670-bd1a-2a8247fe8611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:09.047095 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36edf-1683-4670-bd1a-2a8247fe8611 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:09.047377 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36edf-1683-4670-bd1a-2a8247fe8611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:09.047649 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce36edf-1683-4670-bd1a-2a8247fe8611 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:09.048333 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36edf-1683-4670-bd1a-2a8247fe8611 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:09.050220 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce36edf-1683-4670-bd1a-2a8247fe8611 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:09.075132 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1417/2872] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:32:09 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:32:09.079131 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ee13f-5f59-483d-bf2a-15e1dc62d94e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:09.089392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ee13f-5f59-483d-bf2a-15e1dc62d94e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:09.136886 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:09.147370 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17f87e-bd32-4070-8728-eb7a9de55ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:09.148036 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17f87e-bd32-4070-8728-eb7a9de55ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:09.148323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17f87e-bd32-4070-8728-eb7a9de55ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:09.148603 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17f87e-bd32-4070-8728-eb7a9de55ff8 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:09.149287 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17f87e-bd32-4070-8728-eb7a9de55ff8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:09.151245 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17f87e-bd32-4070-8728-eb7a9de55ff8 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:09.170416 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1456/2873] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:32:09 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:32:09.174542 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36edf-1683-4670-bd1a-2a8247fe8611 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:09.184852 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce36edf-1683-4670-bd1a-2a8247fe8611 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:09.189789 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f285f-116d-4d9e-a4be-2a77c1d118a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:09.190450 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f285f-116d-4d9e-a4be-2a77c1d118a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:09.190736 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f285f-116d-4d9e-a4be-2a77c1d118a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:09.191051 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f285f-116d-4d9e-a4be-2a77c1d118a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:09.191788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f285f-116d-4d9e-a4be-2a77c1d118a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:09.193390 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f285f-116d-4d9e-a4be-2a77c1d118a3 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:09.203887 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1418/2874] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:32:09.208980 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17f87e-bd32-4070-8728-eb7a9de55ff8 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:09.219080 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17f87e-bd32-4070-8728-eb7a9de55ff8 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:09.224495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e9733-e7c0-4793-af00-dd86da61c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:09.225144 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9733-e7c0-4793-af00-dd86da61c679 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:09.225433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9733-e7c0-4793-af00-dd86da61c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:09.225713 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e9733-e7c0-4793-af00-dd86da61c679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:09.226440 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e9733-e7c0-4793-af00-dd86da61c679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:09.228093 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e9733-e7c0-4793-af00-dd86da61c679 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:09.237979 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1457/2875] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 21 04:32:09.242294 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f285f-116d-4d9e-a4be-2a77c1d118a3 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:09.252195 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f285f-116d-4d9e-a4be-2a77c1d118a3 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:09.257084 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854339c-f80e-4d57-8ec1-bedc87959643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:09.257958 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854339c-f80e-4d57-8ec1-bedc87959643 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:09.258244 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854339c-f80e-4d57-8ec1-bedc87959643 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:09.258522 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b854339c-f80e-4d57-8ec1-bedc87959643 admin admin] PATH_INFO: `/v3/projects/010dfde119f74d8393d576d55e69cdd8/users/d57c8fdb18c34271bab47651d6aab10e/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:09.273449 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854339c-f80e-4d57-8ec1-bedc87959643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=010dfde119f74d8393d576d55e69cdd8, user_id=d57c8fdb18c34271bab47651d6aab10e, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:09.276171 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b854339c-f80e-4d57-8ec1-bedc87959643 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:09.289506 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1419/2876] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:32:09 2022] PUT /identity/v3/projects/010dfde119f74d8393d576d55e69cdd8/users/d57c8fdb18c34271bab47651d6aab10e/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:32:09.299861 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780b82-1246-4a20-8d6a-25abaee9b6f4 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:09.300175 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780b82-1246-4a20-8d6a-25abaee9b6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:09.300463 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7780b82-1246-4a20-8d6a-25abaee9b6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:09.328420 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-d7780b82-1246-4a20-8d6a-25abaee9b6f4 None None] MFA Rules not processed for user `d57c8fdb18c34271bab47651d6aab10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:09.329720 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-d7780b82-1246-4a20-8d6a-25abaee9b6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:09.394242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1458/2877] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:09.406360 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854339c-f80e-4d57-8ec1-bedc87959643 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:09.408130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-b854339c-f80e-4d57-8ec1-bedc87959643 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:09.426288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:09.487253 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b854339c-f80e-4d57-8ec1-bedc87959643 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:09.490942 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2117fd8e-cbd1-4ccb-9b73-4bfcb5a89175 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210e10ee6b649399de11ac719a89718', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:09.491605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117fd8e-cbd1-4ccb-9b73-4bfcb5a89175 service glance] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:09.491889 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117fd8e-cbd1-4ccb-9b73-4bfcb5a89175 service glance] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:09.492166 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2117fd8e-cbd1-4ccb-9b73-4bfcb5a89175 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:09.500441 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117fd8e-cbd1-4ccb-9b73-4bfcb5a89175 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:09.501883 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2117fd8e-cbd1-4ccb-9b73-4bfcb5a89175 service glance] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:09.511453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1420/2878] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:32:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:32:19.391291 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:19.507794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=29 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:37.412253 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7780b82-1246-4a20-8d6a-25abaee9b6f4 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:37.475139 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7780b82-1246-4a20-8d6a-25abaee9b6f4 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:37.479604 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:37.480468 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:37.480749 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:37.481022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] PATH_INFO: `/v3/users/d57c8fdb18c34271bab47651d6aab10e` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:37.482305 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d57c8fdb18c34271bab47651d6aab10e)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:37.484327 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:37.528846 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd57c8fdb18c34271bab47651d6aab10e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:37.529518 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd57c8fdb18c34271bab47651d6aab10e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:37.530124 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd57c8fdb18c34271bab47651d6aab10e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:37.536957 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd57c8fdb18c34271bab47651d6aab10e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:37.544218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd57c8fdb18c34271bab47651d6aab10e'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:37.561417 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1459/2879] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:32:37 2022] DELETE /identity/v3/users/d57c8fdb18c34271bab47651d6aab10e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:32:37.566159 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55cf9b-9337-432d-ab77-e89c595070c1 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:37.566700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55cf9b-9337-432d-ab77-e89c595070c1 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:37.566700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55cf9b-9337-432d-ab77-e89c595070c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:37.584708 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-be55cf9b-9337-432d-ab77-e89c595070c1 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:37.585908 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-be55cf9b-9337-432d-ab77-e89c595070c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:37.643232 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1421/2880] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 21 04:32:37.652585 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:37.655122 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:37.712446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a170f33-2fa0-4826-a809-4f57daf1d665 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:37.717277 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c16fb7-b77b-4397-981d-4f611d3e917b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:37.717918 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c16fb7-b77b-4397-981d-4f611d3e917b service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:37.718294 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c16fb7-b77b-4397-981d-4f611d3e917b service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:37.718551 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c16fb7-b77b-4397-981d-4f611d3e917b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:37.727676 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c16fb7-b77b-4397-981d-4f611d3e917b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:37.729118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c16fb7-b77b-4397-981d-4f611d3e917b service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:37.739038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1460/2881] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:32:38.008989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55cf9b-9337-432d-ab77-e89c595070c1 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:38.010509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-be55cf9b-9337-432d-ab77-e89c595070c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:38.024499 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55cf9b-9337-432d-ab77-e89c595070c1 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:38.029543 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:38.030462 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.030741 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.031051 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] PATH_INFO: `/v3/projects/010dfde119f74d8393d576d55e69cdd8` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.032945 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=010dfde119f74d8393d576d55e69cdd8)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:38.034907 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:38.081802 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '010dfde119f74d8393d576d55e69cdd8', 'request_id': 'req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:38.088627 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '010dfde119f74d8393d576d55e69cdd8', 'request_id': 'req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:38.094310 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '010dfde119f74d8393d576d55e69cdd8', 'request_id': 'req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:38.104951 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] The token cache is being invalidate because project 010dfde119f74d8393d576d55e69cdd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:32:38.105251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:38.105858 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-af96d073-6ca2-4bd3-91b7-d73fe1c028f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:38.107496 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1422/2882] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:32:38 2022] DELETE /identity/v3/projects/010dfde119f74d8393d576d55e69cdd8 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:32:38.112356 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625a0b-c897-4884-8380-6249bae05c42 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.112663 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625a0b-c897-4884-8380-6249bae05c42 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.112924 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96625a0b-c897-4884-8380-6249bae05c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.130756 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-96625a0b-c897-4884-8380-6249bae05c42 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:38.131990 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-96625a0b-c897-4884-8380-6249bae05c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:38.149090 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:38.194101 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1461/2883] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:38.201864 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7adbb-7c10-426b-a4f8-cde0b2249b4c None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.202164 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7adbb-7c10-426b-a4f8-cde0b2249b4c None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.202453 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7adbb-7c10-426b-a4f8-cde0b2249b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.220640 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-2cd7adbb-7c10-426b-a4f8-cde0b2249b4c None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:38.221849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2cd7adbb-7c10-426b-a4f8-cde0b2249b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:38.229778 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1423/2884] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:38.234526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625a0b-c897-4884-8380-6249bae05c42 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:38.244156 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96625a0b-c897-4884-8380-6249bae05c42 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:38.249194 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e03d47-4a45-4862-8466-9bd6c7937eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:38.249838 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03d47-4a45-4862-8466-9bd6c7937eb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.250118 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03d47-4a45-4862-8466-9bd6c7937eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.250394 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e03d47-4a45-4862-8466-9bd6c7937eb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.251222 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e03d47-4a45-4862-8466-9bd6c7937eb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:32:38.251529 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e03d47-4a45-4862-8466-9bd6c7937eb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:38.253128 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e03d47-4a45-4862-8466-9bd6c7937eb4 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:38.267068 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1462/2885] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:32:38.271373 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7adbb-7c10-426b-a4f8-cde0b2249b4c None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:38.280832 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7adbb-7c10-426b-a4f8-cde0b2249b4c None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:38.285545 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0176-779a-4582-a86f-3cd8bbcff6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:38.286194 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0176-779a-4582-a86f-3cd8bbcff6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.286480 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0176-779a-4582-a86f-3cd8bbcff6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.286761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0176-779a-4582-a86f-3cd8bbcff6e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.287492 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0176-779a-4582-a86f-3cd8bbcff6e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:38.289509 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0176-779a-4582-a86f-3cd8bbcff6e4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:38.315785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1424/2886] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:32:38 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:32:38.319639 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e03d47-4a45-4862-8466-9bd6c7937eb4 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:38.330249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e03d47-4a45-4862-8466-9bd6c7937eb4 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:38.388446 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326da7-8940-4753-9d05-a2c87f818396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:38.389106 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326da7-8940-4753-9d05-a2c87f818396 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.389393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326da7-8940-4753-9d05-a2c87f818396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.389675 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53326da7-8940-4753-9d05-a2c87f818396 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.390366 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53326da7-8940-4753-9d05-a2c87f818396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:38.392655 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53326da7-8940-4753-9d05-a2c87f818396 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:38.412592 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1463/2887] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:32:38 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 21 04:32:38.416636 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0176-779a-4582-a86f-3cd8bbcff6e4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:38.427421 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0176-779a-4582-a86f-3cd8bbcff6e4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:38.432052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2cc6d-e1a6-4966-812e-e595a0ec5e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:38.432709 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2cc6d-e1a6-4966-812e-e595a0ec5e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.432994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2cc6d-e1a6-4966-812e-e595a0ec5e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.433272 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2cc6d-e1a6-4966-812e-e595a0ec5e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.433995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2cc6d-e1a6-4966-812e-e595a0ec5e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:38.436258 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad2cc6d-e1a6-4966-812e-e595a0ec5e78 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:38.447747 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1425/2888] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:32:38.451740 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326da7-8940-4753-9d05-a2c87f818396 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:38.461670 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53326da7-8940-4753-9d05-a2c87f818396 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:38.466975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89a4ab-47f8-4795-94d4-a8a2845745a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:38.467874 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89a4ab-47f8-4795-94d4-a8a2845745a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.468296 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89a4ab-47f8-4795-94d4-a8a2845745a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.468582 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89a4ab-47f8-4795-94d4-a8a2845745a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.469319 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89a4ab-47f8-4795-94d4-a8a2845745a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:38.470927 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89a4ab-47f8-4795-94d4-a8a2845745a1 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:38.481171 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1464/2889] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:32:38.486128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2cc6d-e1a6-4966-812e-e595a0ec5e78 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:38.495956 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad2cc6d-e1a6-4966-812e-e595a0ec5e78 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:38.501354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239e0b7-0561-4772-95e7-dd73e07dd0db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:38.502218 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e0b7-0561-4772-95e7-dd73e07dd0db admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.502821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e0b7-0561-4772-95e7-dd73e07dd0db admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.502821 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239e0b7-0561-4772-95e7-dd73e07dd0db admin admin] PATH_INFO: `/v3/projects/fe1f8ca5e93a4bb4811dd10e1be4343c/users/a0f44f6bbbea401092ff7ad4f999b962/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.638529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239e0b7-0561-4772-95e7-dd73e07dd0db admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1f8ca5e93a4bb4811dd10e1be4343c, user_id=a0f44f6bbbea401092ff7ad4f999b962, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:38.641199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239e0b7-0561-4772-95e7-dd73e07dd0db admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:38.654444 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1426/2890] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:32:38 2022] PUT /identity/v3/projects/fe1f8ca5e93a4bb4811dd10e1be4343c/users/a0f44f6bbbea401092ff7ad4f999b962/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:32:38.666024 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c646568-5316-486c-9c9a-53327cf6ebc3 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.666320 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c646568-5316-486c-9c9a-53327cf6ebc3 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.666606 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c646568-5316-486c-9c9a-53327cf6ebc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.695183 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-8c646568-5316-486c-9c9a-53327cf6ebc3 None None] MFA Rules not processed for user `a0f44f6bbbea401092ff7ad4f999b962`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:38.696435 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8c646568-5316-486c-9c9a-53327cf6ebc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:38.759816 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1465/2891] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:38.770657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239e0b7-0561-4772-95e7-dd73e07dd0db admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:38.772323 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-d239e0b7-0561-4772-95e7-dd73e07dd0db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:38.795167 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:38.831237 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239e0b7-0561-4772-95e7-dd73e07dd0db admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:38.834874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692910f1-18e1-45b8-9e77-37f6ea586904 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '92407a5a276247e79d2abe41fee54c33', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:38.835540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692910f1-18e1-45b8-9e77-37f6ea586904 service cinder] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.835826 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692910f1-18e1-45b8-9e77-37f6ea586904 service cinder] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.836107 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692910f1-18e1-45b8-9e77-37f6ea586904 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.845052 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692910f1-18e1-45b8-9e77-37f6ea586904 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:38.846472 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692910f1-18e1-45b8-9e77-37f6ea586904 service cinder] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:38.855171 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1427/2892] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:32:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:32:38.879374 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c646568-5316-486c-9c9a-53327cf6ebc3 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:38.898034 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:38.942439 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c646568-5316-486c-9c9a-53327cf6ebc3 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:38.947063 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:38.947944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:38.948728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:38.948728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] PATH_INFO: `/v3/users/a0f44f6bbbea401092ff7ad4f999b962` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:38.949697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0f44f6bbbea401092ff7ad4f999b962)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:38.952179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:38.997910 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0f44f6bbbea401092ff7ad4f999b962'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:38.998564 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0f44f6bbbea401092ff7ad4f999b962'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:38.999216 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0f44f6bbbea401092ff7ad4f999b962'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:39.006179 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0f44f6bbbea401092ff7ad4f999b962'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:39.014467 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0f44f6bbbea401092ff7ad4f999b962'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:39.031871 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1466/2893] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:32:38 2022] DELETE /identity/v3/users/a0f44f6bbbea401092ff7ad4f999b962 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:32:39.036416 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a8eb-f2b7-4602-9297-2bf6dd7b428e None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.036712 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a8eb-f2b7-4602-9297-2bf6dd7b428e None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.036995 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428a8eb-f2b7-4602-9297-2bf6dd7b428e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.054023 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-9428a8eb-f2b7-4602-9297-2bf6dd7b428e None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:39.055262 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9428a8eb-f2b7-4602-9297-2bf6dd7b428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:39.113381 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1428/2894] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:39.123925 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:39.125716 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:39.184393 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baaa39-c400-4fd9-ba39-c675d7b1595e admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:39.188921 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587687a-c54f-4706-a47f-9ca72d4025dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:39.189823 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587687a-c54f-4706-a47f-9ca72d4025dd service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.190111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587687a-c54f-4706-a47f-9ca72d4025dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.190392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587687a-c54f-4706-a47f-9ca72d4025dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.199646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587687a-c54f-4706-a47f-9ca72d4025dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:39.201313 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587687a-c54f-4706-a47f-9ca72d4025dd service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:39.211149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1467/2895] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 21 04:32:39.475672 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a8eb-f2b7-4602-9297-2bf6dd7b428e None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:39.477127 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-9428a8eb-f2b7-4602-9297-2bf6dd7b428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:39.491620 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428a8eb-f2b7-4602-9297-2bf6dd7b428e None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:39.496225 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:39.497077 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.497386 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.497652 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] PATH_INFO: `/v3/projects/fe1f8ca5e93a4bb4811dd10e1be4343c` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.498822 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1f8ca5e93a4bb4811dd10e1be4343c)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:39.501532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:39.547905 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1f8ca5e93a4bb4811dd10e1be4343c', 'request_id': 'req-e983430b-87c1-4dc9-bb24-26545fc0200d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:39.555000 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1f8ca5e93a4bb4811dd10e1be4343c', 'request_id': 'req-e983430b-87c1-4dc9-bb24-26545fc0200d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:39.560695 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1f8ca5e93a4bb4811dd10e1be4343c', 'request_id': 'req-e983430b-87c1-4dc9-bb24-26545fc0200d'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:39.572092 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] The token cache is being invalidate because project fe1f8ca5e93a4bb4811dd10e1be4343c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80606) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:32:39.572378 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:39.573004 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-e983430b-87c1-4dc9-bb24-26545fc0200d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:32:39.574519 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1429/2896] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:32:39 2022] DELETE /identity/v3/projects/fe1f8ca5e93a4bb4811dd10e1be4343c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:32:39.579737 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b935e2-acc8-4e95-b202-fc9b9822ef94 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.580236 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b935e2-acc8-4e95-b202-fc9b9822ef94 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.580343 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b935e2-acc8-4e95-b202-fc9b9822ef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.597864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-a3b935e2-acc8-4e95-b202-fc9b9822ef94 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:39.599102 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-a3b935e2-acc8-4e95-b202-fc9b9822ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:39.631662 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:39.658728 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1468/2897] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:39.666363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3457b0-4f19-4363-89c1-e09e73047e96 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.666842 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3457b0-4f19-4363-89c1-e09e73047e96 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.666948 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3457b0-4f19-4363-89c1-e09e73047e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.685347 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-ee3457b0-4f19-4363-89c1-e09e73047e96 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:39.686547 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-ee3457b0-4f19-4363-89c1-e09e73047e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:39.694657 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1430/2898] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:39.698610 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b935e2-acc8-4e95-b202-fc9b9822ef94 None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:39.708613 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b935e2-acc8-4e95-b202-fc9b9822ef94 None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:39.713207 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad492cd-abae-4d9b-be1c-10a98283f7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:39.713857 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad492cd-abae-4d9b-be1c-10a98283f7f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.714146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad492cd-abae-4d9b-be1c-10a98283f7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.714427 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad492cd-abae-4d9b-be1c-10a98283f7f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.715208 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad492cd-abae-4d9b-be1c-10a98283f7f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80605) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 21 04:32:39.715522 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad492cd-abae-4d9b-be1c-10a98283f7f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:39.717746 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad492cd-abae-4d9b-be1c-10a98283f7f3 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:39.729258 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1469/2899] 10.222.0.48 () {58 vars in 1152 bytes} [Thu Jul 21 04:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 21 04:32:39.733771 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3457b0-4f19-4363-89c1-e09e73047e96 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:39.742804 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3457b0-4f19-4363-89c1-e09e73047e96 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:39.747556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee1fdf-5357-4d9b-83bc-e3728637d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:39.748196 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee1fdf-5357-4d9b-83bc-e3728637d937 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.748482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee1fdf-5357-4d9b-83bc-e3728637d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.748759 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee1fdf-5357-4d9b-83bc-e3728637d937 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.749447 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee1fdf-5357-4d9b-83bc-e3728637d937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:39.751384 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee1fdf-5357-4d9b-83bc-e3728637d937 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:39.777720 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1431/2900] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:32:39 2022] POST /identity/v3/projects => generated 371 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:32:39.782383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad492cd-abae-4d9b-be1c-10a98283f7f3 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:39.792426 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad492cd-abae-4d9b-be1c-10a98283f7f3 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:39.849052 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acdaf2-c443-4f60-ae36-c524e0d228e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:39.849644 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acdaf2-c443-4f60-ae36-c524e0d228e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.849932 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acdaf2-c443-4f60-ae36-c524e0d228e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.850214 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68acdaf2-c443-4f60-ae36-c524e0d228e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.850899 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acdaf2-c443-4f60-ae36-c524e0d228e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:39.852869 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68acdaf2-c443-4f60-ae36-c524e0d228e1 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:39.872375 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1470/2901] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:32:39 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:32:39.876430 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee1fdf-5357-4d9b-83bc-e3728637d937 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:39.886533 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee1fdf-5357-4d9b-83bc-e3728637d937 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:39.891719 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc13e82-5f9d-42d2-b0f0-024ca1b05fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:39.892369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc13e82-5f9d-42d2-b0f0-024ca1b05fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.892651 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc13e82-5f9d-42d2-b0f0-024ca1b05fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.892955 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc13e82-5f9d-42d2-b0f0-024ca1b05fd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.893675 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc13e82-5f9d-42d2-b0f0-024ca1b05fd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:39.895299 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc13e82-5f9d-42d2-b0f0-024ca1b05fd4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:39.906305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1432/2902] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:32:39.909915 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acdaf2-c443-4f60-ae36-c524e0d228e1 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:39.919991 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68acdaf2-c443-4f60-ae36-c524e0d228e1 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:39.924589 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247b0e9-aa7d-481c-a490-ac444b537c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:39.925242 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b0e9-aa7d-481c-a490-ac444b537c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.925531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b0e9-aa7d-481c-a490-ac444b537c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.925817 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b0e9-aa7d-481c-a490-ac444b537c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.926544 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247b0e9-aa7d-481c-a490-ac444b537c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:39.928190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247b0e9-aa7d-481c-a490-ac444b537c6e admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:39.937981 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1471/2903] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:32:39.942069 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc13e82-5f9d-42d2-b0f0-024ca1b05fd4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:39.952146 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc13e82-5f9d-42d2-b0f0-024ca1b05fd4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:39.956656 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f4323-7b6c-4ea9-8cf9-23cd0880a2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:39.957505 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f4323-7b6c-4ea9-8cf9-23cd0880a2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.957784 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f4323-7b6c-4ea9-8cf9-23cd0880a2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.958058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f4323-7b6c-4ea9-8cf9-23cd0880a2d2 admin admin] PATH_INFO: `/v3/projects/6a16bf2fa21b46a2b971ed885a77bbd2/users/36a8b537292e47cbb6adc034e9716735/roles/49806c1799404d039cb4e2a11f1d4442` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:39.960254 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:39.975079 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f4323-7b6c-4ea9-8cf9-23cd0880a2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a16bf2fa21b46a2b971ed885a77bbd2, user_id=36a8b537292e47cbb6adc034e9716735, role_id=49806c1799404d039cb4e2a11f1d4442)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:39.977697 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6f4323-7b6c-4ea9-8cf9-23cd0880a2d2 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:39.989612 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1433/2904] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:32:39 2022] PUT /identity/v3/projects/6a16bf2fa21b46a2b971ed885a77bbd2/users/36a8b537292e47cbb6adc034e9716735/roles/49806c1799404d039cb4e2a11f1d4442 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:32:39.994526 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb925f-b4d8-4de5-9ce0-8079e6a2acc0 None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:39.994818 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb925f-b4d8-4de5-9ce0-8079e6a2acc0 None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:39.995130 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fb925f-b4d8-4de5-9ce0-8079e6a2acc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:40.013902 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-06fb925f-b4d8-4de5-9ce0-8079e6a2acc0 None None] MFA Rules not processed for user `9b72d80a668e4df2ad631da1eeae4189`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:40.015172 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-06fb925f-b4d8-4de5-9ce0-8079e6a2acc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:40.074260 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1472/2905] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:40.084586 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f4323-7b6c-4ea9-8cf9-23cd0880a2d2 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:40.086306 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-bb6f4323-7b6c-4ea9-8cf9-23cd0880a2d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:40.142370 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6f4323-7b6c-4ea9-8cf9-23cd0880a2d2 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:40.145877 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115af012-26ca-4699-9ff5-3ffd01f7c092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:40.146512 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115af012-26ca-4699-9ff5-3ffd01f7c092 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:40.146794 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115af012-26ca-4699-9ff5-3ffd01f7c092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:40.147111 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115af012-26ca-4699-9ff5-3ffd01f7c092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:40.156060 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115af012-26ca-4699-9ff5-3ffd01f7c092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:40.157475 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115af012-26ca-4699-9ff5-3ffd01f7c092 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:40.166642 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1434/2906] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:32:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:32:44.047628 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319c1ad-624b-45ea-af90-927223a666bb None None] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:44.048136 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319c1ad-624b-45ea-af90-927223a666bb None None] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:44.048251 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319c1ad-624b-45ea-af90-927223a666bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:44.084189 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.auth.core [None req-7319c1ad-624b-45ea-af90-927223a666bb None None] MFA Rules not processed for user `36a8b537292e47cbb6adc034e9716735`. Rule list: `[]` (Enabled: `True`). {{(pid=80605) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:44.085423 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-7319c1ad-624b-45ea-af90-927223a666bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:44.125184 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:44.164870 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1473/2907] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:44.169532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115af012-26ca-4699-9ff5-3ffd01f7c092 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:44.186278 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115af012-26ca-4699-9ff5-3ffd01f7c092 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:44.192045 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe85e22-a848-40e2-91c8-2de8575706e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:44.192762 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe85e22-a848-40e2-91c8-2de8575706e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:44.193058 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe85e22-a848-40e2-91c8-2de8575706e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:44.193398 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe85e22-a848-40e2-91c8-2de8575706e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:44.194029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe85e22-a848-40e2-91c8-2de8575706e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:44.196091 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe85e22-a848-40e2-91c8-2de8575706e7 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:44.234238 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1435/2908] 10.222.0.48 () {60 vars in 1152 bytes} [Thu Jul 21 04:32:44 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:32:44.235726 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319c1ad-624b-45ea-af90-927223a666bb None None] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:44.247685 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319c1ad-624b-45ea-af90-927223a666bb None None] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:44.316084 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4238f9d-04dc-494f-bbfb-854d8c9b87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:44.316762 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238f9d-04dc-494f-bbfb-854d8c9b87cf admin admin] REQUEST_METHOD: `POST` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:44.317050 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238f9d-04dc-494f-bbfb-854d8c9b87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:44.317332 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238f9d-04dc-494f-bbfb-854d8c9b87cf admin admin] PATH_INFO: `/v3/users` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:44.318033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4238f9d-04dc-494f-bbfb-854d8c9b87cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:44.320062 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4238f9d-04dc-494f-bbfb-854d8c9b87cf admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:44.340205 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1474/2909] 10.222.0.48 () {60 vars in 1143 bytes} [Thu Jul 21 04:32:44 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 21 04:32:44.344957 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe85e22-a848-40e2-91c8-2de8575706e7 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:44.355158 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe85e22-a848-40e2-91c8-2de8575706e7 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:44.360061 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47304d-b613-4841-b15a-a8155d800dbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:44.360742 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47304d-b613-4841-b15a-a8155d800dbc admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:44.361030 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47304d-b613-4841-b15a-a8155d800dbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:44.361312 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a47304d-b613-4841-b15a-a8155d800dbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:44.362044 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47304d-b613-4841-b15a-a8155d800dbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:44.363685 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a47304d-b613-4841-b15a-a8155d800dbc admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:44.374815 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1436/2910] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:32:44.379022 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4238f9d-04dc-494f-bbfb-854d8c9b87cf admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:44.389523 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4238f9d-04dc-494f-bbfb-854d8c9b87cf admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:44.394646 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d10ad0-e0e6-4add-8441-3caadf91d621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:44.395651 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d10ad0-e0e6-4add-8441-3caadf91d621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:44.395968 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d10ad0-e0e6-4add-8441-3caadf91d621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:44.396255 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d10ad0-e0e6-4add-8441-3caadf91d621 admin admin] PATH_INFO: `/v3/projects/7170f10e7926408eba35e55738fc4a4d/users/677f94f9038a469bafbb0b83a3be1355/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:44.411955 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d10ad0-e0e6-4add-8441-3caadf91d621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7170f10e7926408eba35e55738fc4a4d, user_id=677f94f9038a469bafbb0b83a3be1355, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:44.414674 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d10ad0-e0e6-4add-8441-3caadf91d621 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:44.427712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1475/2911] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:32:44 2022] PUT /identity/v3/projects/7170f10e7926408eba35e55738fc4a4d/users/677f94f9038a469bafbb0b83a3be1355/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:32:44.431586 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47304d-b613-4841-b15a-a8155d800dbc admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:44.441876 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a47304d-b613-4841-b15a-a8155d800dbc admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:44.497922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f44b098-2835-47ef-be7a-0cb1d6ee6ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:44.498593 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b098-2835-47ef-be7a-0cb1d6ee6ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:44.498946 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b098-2835-47ef-be7a-0cb1d6ee6ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:44.499188 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f44b098-2835-47ef-be7a-0cb1d6ee6ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:44.499917 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44b098-2835-47ef-be7a-0cb1d6ee6ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:44.501526 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f44b098-2835-47ef-be7a-0cb1d6ee6ee4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:44.512529 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1437/2912] 10.222.0.48 () {58 vars in 1121 bytes} [Thu Jul 21 04:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 21 04:32:44.517348 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d10ad0-e0e6-4add-8441-3caadf91d621 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:44.527916 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d10ad0-e0e6-4add-8441-3caadf91d621 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:44.533495 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee4c0-4ac0-4982-9e10-011e73ecb8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:44.534397 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee4c0-4ac0-4982-9e10-011e73ecb8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:44.534677 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee4c0-4ac0-4982-9e10-011e73ecb8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:44.535004 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dee4c0-4ac0-4982-9e10-011e73ecb8bb admin admin] PATH_INFO: `/v3/projects/7170f10e7926408eba35e55738fc4a4d/users/677f94f9038a469bafbb0b83a3be1355/roles/5756f6673fe74f729c39ec094f99c3c9` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:44.536973 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee4c0-4ac0-4982-9e10-011e73ecb8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7170f10e7926408eba35e55738fc4a4d, user_id=677f94f9038a469bafbb0b83a3be1355, role_id=5756f6673fe74f729c39ec094f99c3c9)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:44.539698 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dee4c0-4ac0-4982-9e10-011e73ecb8bb admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:44.550010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1476/2913] 10.222.0.48 () {60 vars in 1482 bytes} [Thu Jul 21 04:32:44 2022] PUT /identity/v3/projects/7170f10e7926408eba35e55738fc4a4d/users/677f94f9038a469bafbb0b83a3be1355/roles/5756f6673fe74f729c39ec094f99c3c9 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:32:49.028050 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054722e-cfaa-4975-9db6-279a91809437 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:49.029200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054722e-cfaa-4975-9db6-279a91809437 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:49.029200 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054722e-cfaa-4975-9db6-279a91809437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:49.058409 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-6054722e-cfaa-4975-9db6-279a91809437 None None] MFA Rules not processed for user `677f94f9038a469bafbb0b83a3be1355`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:49.060298 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-6054722e-cfaa-4975-9db6-279a91809437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:49.101097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:49.134288 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1438/2914] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:49.152341 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee4c0-4ac0-4982-9e10-011e73ecb8bb admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:32:49.156328 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-c2dee4c0-4ac0-4982-9e10-011e73ecb8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:49.245780 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dee4c0-4ac0-4982-9e10-011e73ecb8bb admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:32:49.252280 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfb8f6-73eb-4a4c-9ac3-7385270a970e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:32:49.253010 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfb8f6-73eb-4a4c-9ac3-7385270a970e service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:49.253298 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfb8f6-73eb-4a4c-9ac3-7385270a970e service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:49.253573 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cfb8f6-73eb-4a4c-9ac3-7385270a970e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:49.282642 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:32:49.318739 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfb8f6-73eb-4a4c-9ac3-7385270a970e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:32:49.320508 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cfb8f6-73eb-4a4c-9ac3-7385270a970e service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:32:49.331218 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1477/2915] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:32:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:32:50.335871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b148d5-19d4-4be3-86fc-b88cde2f3208 None None] REQUEST_METHOD: `POST` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:32:50.336369 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b148d5-19d4-4be3-86fc-b88cde2f3208 None None] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:32:50.336486 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b148d5-19d4-4be3-86fc-b88cde2f3208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:32:50.354305 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.auth.core [None req-31b148d5-19d4-4be3-86fc-b88cde2f3208 None None] MFA Rules not processed for user `36a8b537292e47cbb6adc034e9716735`. Rule list: `[]` (Enabled: `True`). {{(pid=80606) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 21 04:32:50.355532 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-31b148d5-19d4-4be3-86fc-b88cde2f3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:32:50.362327 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1439/2916] 10.222.0.48 () {58 vars in 957 bytes} [Thu Jul 21 04:32:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 21 04:32:59.325952 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=16 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:33:00.349040 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=15 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:33:10.609658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfb8f6-73eb-4a4c-9ac3-7385270a970e service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:33:10.679487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cfb8f6-73eb-4a4c-9ac3-7385270a970e service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:33:10.683087 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd961f70-ae22-49d5-a183-1eaeaa45ed78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:33:10.683742 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd961f70-ae22-49d5-a183-1eaeaa45ed78 service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:33:10.684037 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd961f70-ae22-49d5-a183-1eaeaa45ed78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:33:10.684349 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd961f70-ae22-49d5-a183-1eaeaa45ed78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:33:10.687392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fd961f70-ae22-49d5-a183-1eaeaa45ed78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:33:10.702362 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd961f70-ae22-49d5-a183-1eaeaa45ed78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:33:10.703864 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd961f70-ae22-49d5-a183-1eaeaa45ed78 service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:33:10.715586 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1478/2917] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:33:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:33:14.304524 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b148d5-19d4-4be3-86fc-b88cde2f3208 None None] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:33:14.305910 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-31b148d5-19d4-4be3-86fc-b88cde2f3208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:33:14.318124 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b148d5-19d4-4be3-86fc-b88cde2f3208 None None] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:33:14.321703 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7139fd1-7798-4063-9246-ed7c408f90e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:33:14.322332 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7139fd1-7798-4063-9246-ed7c408f90e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:33:14.322605 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7139fd1-7798-4063-9246-ed7c408f90e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:33:14.322874 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7139fd1-7798-4063-9246-ed7c408f90e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:33:14.324648 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-f7139fd1-7798-4063-9246-ed7c408f90e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:33:14.338100 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7139fd1-7798-4063-9246-ed7c408f90e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:33:14.339560 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7139fd1-7798-4063-9246-ed7c408f90e2 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:33:14.350891 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1440/2918] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:33:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:33:20.497376 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd961f70-ae22-49d5-a183-1eaeaa45ed78 service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:33:20.506877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd961f70-ae22-49d5-a183-1eaeaa45ed78 service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:33:20.510568 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb6ae0-94a8-4537-9720-480d83b4ac1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:33:20.511243 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb6ae0-94a8-4537-9720-480d83b4ac1f service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:33:20.511531 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb6ae0-94a8-4537-9720-480d83b4ac1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:33:20.511811 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bb6ae0-94a8-4537-9720-480d83b4ac1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:33:20.520944 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb6ae0-94a8-4537-9720-480d83b4ac1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:33:20.522398 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bb6ae0-94a8-4537-9720-480d83b4ac1f service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:33:20.532297 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1479/2919] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:33:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:33:24.346097 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=6 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:33:30.527712 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=32 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:34:15.482037 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7139fd1-7798-4063-9246-ed7c408f90e2 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:34:15.491304 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7139fd1-7798-4063-9246-ed7c408f90e2 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:34:15.494893 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b180496-4d2d-4bca-807e-a96a76d13c73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:34:15.495555 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b180496-4d2d-4bca-807e-a96a76d13c73 service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:34:15.495836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b180496-4d2d-4bca-807e-a96a76d13c73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:34:15.496108 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b180496-4d2d-4bca-807e-a96a76d13c73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:34:15.497871 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-3b180496-4d2d-4bca-807e-a96a76d13c73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:34:15.508123 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b180496-4d2d-4bca-807e-a96a76d13c73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:34:15.509540 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b180496-4d2d-4bca-807e-a96a76d13c73 service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:34:15.517436 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1441/2920] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:34:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:34:25.513989 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=6 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:35:58.382711 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb6ae0-94a8-4537-9720-480d83b4ac1f service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:35:58.391738 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bb6ae0-94a8-4537-9720-480d83b4ac1f service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:35:58.395502 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d205cd6-9a08-4893-b80f-aa2a1a8d31fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:35:58.396149 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d205cd6-9a08-4893-b80f-aa2a1a8d31fb service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:35:58.396433 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d205cd6-9a08-4893-b80f-aa2a1a8d31fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:35:58.396722 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d205cd6-9a08-4893-b80f-aa2a1a8d31fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:35:58.398492 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8d205cd6-9a08-4893-b80f-aa2a1a8d31fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:35:58.408933 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d205cd6-9a08-4893-b80f-aa2a1a8d31fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:35:58.410387 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d205cd6-9a08-4893-b80f-aa2a1a8d31fb service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:35:58.419482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1480/2921] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:35:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:35:59.499973 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b180496-4d2d-4bca-807e-a96a76d13c73 service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:35:59.509476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b180496-4d2d-4bca-807e-a96a76d13c73 service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:35:59.513199 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1042df-c8fc-4528-97e6-6fd4c86b925b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:35:59.513836 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1042df-c8fc-4528-97e6-6fd4c86b925b service neutron] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:35:59.514122 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1042df-c8fc-4528-97e6-6fd4c86b925b service neutron] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:35:59.514401 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1042df-c8fc-4528-97e6-6fd4c86b925b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:35:59.516198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2c1042df-c8fc-4528-97e6-6fd4c86b925b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:35:59.530321 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1042df-c8fc-4528-97e6-6fd4c86b925b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:35:59.531788 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1042df-c8fc-4528-97e6-6fd4c86b925b service neutron] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:35:59.543482 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1442/2922] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:35:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:35:59.638088 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d205cd6-9a08-4893-b80f-aa2a1a8d31fb service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:35:59.639697 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8d205cd6-9a08-4893-b80f-aa2a1a8d31fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:35:59.712247 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d205cd6-9a08-4893-b80f-aa2a1a8d31fb service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:35:59.717392 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59c65d-f7fe-42fe-b138-129b734998c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:35:59.718082 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59c65d-f7fe-42fe-b138-129b734998c1 service placement] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:35:59.718358 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59c65d-f7fe-42fe-b138-129b734998c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:35:59.718637 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59c65d-f7fe-42fe-b138-129b734998c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:35:59.720451 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-fb59c65d-f7fe-42fe-b138-129b734998c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:35:59.732482 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59c65d-f7fe-42fe-b138-129b734998c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:35:59.734053 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb59c65d-f7fe-42fe-b138-129b734998c1 service placement] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:35:59.743941 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1481/2923] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:35:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:36:09.538031 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=6 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:36:09.739691 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=38 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:37:20.736933 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1042df-c8fc-4528-97e6-6fd4c86b925b service neutron] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:37:20.738597 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-2c1042df-c8fc-4528-97e6-6fd4c86b925b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:37:20.825645 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1042df-c8fc-4528-97e6-6fd4c86b925b service neutron] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:37:20.830807 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d85cbd-dde3-4c8f-90c1-23babfed4475 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:37:20.831476 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85cbd-dde3-4c8f-90c1-23babfed4475 service placement] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:37:20.831757 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85cbd-dde3-4c8f-90c1-23babfed4475 service placement] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:37:20.832029 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d85cbd-dde3-4c8f-90c1-23babfed4475 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:37:20.833779 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-77d85cbd-dde3-4c8f-90c1-23babfed4475 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:37:20.845604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d85cbd-dde3-4c8f-90c1-23babfed4475 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:37:20.847198 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d85cbd-dde3-4c8f-90c1-23babfed4475 service placement] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:37:20.857700 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1443/2924] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:37:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:37:30.853666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=37 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:37:48.841270 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59c65d-f7fe-42fe-b138-129b734998c1 service placement] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:37:48.919877 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb59c65d-f7fe-42fe-b138-129b734998c1 service placement] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:37:48.926383 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab55fb6-d29d-49d4-94b2-9cf42a10acde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:37:48.928111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55fb6-d29d-49d4-94b2-9cf42a10acde service nova] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:37:48.928111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55fb6-d29d-49d4-94b2-9cf42a10acde service nova] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:37:48.928111 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab55fb6-d29d-49d4-94b2-9cf42a10acde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:37:48.929473 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-4ab55fb6-d29d-49d4-94b2-9cf42a10acde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:37:48.956975 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab55fb6-d29d-49d4-94b2-9cf42a10acde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:37:48.958612 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab55fb6-d29d-49d4-94b2-9cf42a10acde service nova] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:37:48.974190 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1482/2925] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:37:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:37:49.982761 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d85cbd-dde3-4c8f-90c1-23babfed4475 service placement] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:37:49.994901 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d85cbd-dde3-4c8f-90c1-23babfed4475 service placement] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:37:50.000292 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6a7d4-e26a-4921-b3cd-6eb67c9d090a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5a82fed4ff8845919b1da05f7e8d1d72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:37:50.000922 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6a7d4-e26a-4921-b3cd-6eb67c9d090a service nova] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:37:50.001202 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6a7d4-e26a-4921-b3cd-6eb67c9d090a service nova] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:37:50.001474 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6a7d4-e26a-4921-b3cd-6eb67c9d090a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:37:50.009276 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6a7d4-e26a-4921-b3cd-6eb67c9d090a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:37:50.010849 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6a7d4-e26a-4921-b3cd-6eb67c9d090a service nova] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:37:50.019750 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1444/2926] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:37:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:37:53.938853 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab55fb6-d29d-49d4-94b2-9cf42a10acde service nova] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:37:53.958359 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab55fb6-d29d-49d4-94b2-9cf42a10acde service nova] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:37:53.962560 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ef00d-5169-4a14-bd00-df4efdca421f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b3b2d5dee6d240558a71331e05035a30', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:37:53.963249 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ef00d-5169-4a14-bd00-df4efdca421f service neutron] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:37:53.963530 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ef00d-5169-4a14-bd00-df4efdca421f service neutron] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:37:53.963805 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215ef00d-5169-4a14-bd00-df4efdca421f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:37:54.034117 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ef00d-5169-4a14-bd00-df4efdca421f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:37:54.036038 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215ef00d-5169-4a14-bd00-df4efdca421f service neutron] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:37:54.056549 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1483/2927] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:37:57.161468 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6a7d4-e26a-4921-b3cd-6eb67c9d090a service nova] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:37:57.173354 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6a7d4-e26a-4921-b3cd-6eb67c9d090a service nova] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:37:57.178363 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c708d63-810b-4c78-a233-2d282a61004a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:37:57.185785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c708d63-810b-4c78-a233-2d282a61004a service placement] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:37:57.185785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c708d63-810b-4c78-a233-2d282a61004a service placement] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:37:57.185785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c708d63-810b-4c78-a233-2d282a61004a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:37:57.185785 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-5c708d63-810b-4c78-a233-2d282a61004a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:37:57.198626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c708d63-810b-4c78-a233-2d282a61004a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:37:57.200718 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c708d63-810b-4c78-a233-2d282a61004a service placement] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:37:57.217128 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1445/2928] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:37:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:38:00.077146 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ef00d-5169-4a14-bd00-df4efdca421f service neutron] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:38:00.109536 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215ef00d-5169-4a14-bd00-df4efdca421f service neutron] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:38:00.120541 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad3081-b98a-451c-90fa-dd668593c64e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:38:00.121078 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad3081-b98a-451c-90fa-dd668593c64e service placement] REQUEST_METHOD: `GET` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:38:00.121540 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad3081-b98a-451c-90fa-dd668593c64e service placement] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:38:00.122097 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad3081-b98a-451c-90fa-dd668593c64e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:38:00.124893 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-26ad3081-b98a-451c-90fa-dd668593c64e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:38:00.140591 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c708d63-810b-4c78-a233-2d282a61004a service placement] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:38:00.141369 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad3081-b98a-451c-90fa-dd668593c64e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:38:00.143067 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad3081-b98a-451c-90fa-dd668593c64e service placement] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:38:00.151607 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c708d63-810b-4c78-a233-2d282a61004a service placement] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:38:00.154225 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1484/2929] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:38:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:38:00.160392 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:38:00.161413 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:38:00.161805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:38:00.162176 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] PATH_INFO: `/v3/users/36a8b537292e47cbb6adc034e9716735` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:38:00.163581 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a8b537292e47cbb6adc034e9716735)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:38:00.166805 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:38:00.218325 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a8b537292e47cbb6adc034e9716735'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.219024 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a8b537292e47cbb6adc034e9716735'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.219625 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a8b537292e47cbb6adc034e9716735'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.226451 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a8b537292e47cbb6adc034e9716735'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.234364 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a8b537292e47cbb6adc034e9716735'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.251797 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1446/2930] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:38:00 2022] DELETE /identity/v3/users/36a8b537292e47cbb6adc034e9716735 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:38:00.423812 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad3081-b98a-451c-90fa-dd668593c64e service placement] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:38:00.436974 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad3081-b98a-451c-90fa-dd668593c64e service placement] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:38:00.472323 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=100 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:38:00.495607 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:38:00.496469 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:38:00.496755 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:38:00.497033 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] PATH_INFO: `/v3/projects/6a16bf2fa21b46a2b971ed885a77bbd2` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:38:00.498198 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a16bf2fa21b46a2b971ed885a77bbd2)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:38:00.500162 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:38:00.545598 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a16bf2fa21b46a2b971ed885a77bbd2', 'request_id': 'req-8b290ada-711e-490b-979e-8a896502a337'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.553091 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a16bf2fa21b46a2b971ed885a77bbd2', 'request_id': 'req-8b290ada-711e-490b-979e-8a896502a337'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.559978 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a16bf2fa21b46a2b971ed885a77bbd2', 'request_id': 'req-8b290ada-711e-490b-979e-8a896502a337'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.583571 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] The token cache is being invalidate because project 6a16bf2fa21b46a2b971ed885a77bbd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:38:00.583866 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.584487 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.586229 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1485/2931] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:38:00 2022] DELETE /identity/v3/projects/6a16bf2fa21b46a2b971ed885a77bbd2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 21 04:38:00.590157 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:38:00.591626 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:38:00.604666 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14734217-1135-4807-8e01-7265891b1fa4 admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:38:00.660813 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:38:00.661688 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:38:00.661971 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:38:00.662264 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] PATH_INFO: `/v3/users/677f94f9038a469bafbb0b83a3be1355` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:38:00.663483 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] RBAC: Authorizing `identity:delete_user(user_id=677f94f9038a469bafbb0b83a3be1355)` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:38:00.665721 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:38:00.712033 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '677f94f9038a469bafbb0b83a3be1355'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.712669 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '677f94f9038a469bafbb0b83a3be1355'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.713265 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '677f94f9038a469bafbb0b83a3be1355'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.714448 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:38:00.722445 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '677f94f9038a469bafbb0b83a3be1355'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.730898 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.notifications [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '677f94f9038a469bafbb0b83a3be1355'} {{(pid=80606) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:00.750485 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1447/2932] 10.222.0.48 () {58 vars in 1223 bytes} [Thu Jul 21 04:38:00 2022] DELETE /identity/v3/users/677f94f9038a469bafbb0b83a3be1355 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:38:00.924138 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] Authenticating user token {{(pid=80605) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:38:00.925671 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.fernet_utils [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80605) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:38:00.941626 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b290ada-711e-490b-979e-8a896502a337 admin admin] Validating token access rules against request {{(pid=80605) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:38:01.001054 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b72d80a668e4df2ad631da1eeae4189', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '39bed1c15cc5411994e7f051730f1155', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80605) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:38:01.001913 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:38:01.002197 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:38:01.002478 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] PATH_INFO: `/v3/projects/7170f10e7926408eba35e55738fc4a4d` {{(pid=80605) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:38:01.003658 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7170f10e7926408eba35e55738fc4a4d)` {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:38:01.005627 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] RBAC: Authorization granted {{(pid=80605) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:38:01.051217 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7170f10e7926408eba35e55738fc4a4d', 'request_id': 'req-b2f9a195-e8c3-4e7f-ae2a-061a59317753'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:01.058880 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7170f10e7926408eba35e55738fc4a4d', 'request_id': 'req-b2f9a195-e8c3-4e7f-ae2a-061a59317753'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:01.060834 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:38:01.065351 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7170f10e7926408eba35e55738fc4a4d', 'request_id': 'req-b2f9a195-e8c3-4e7f-ae2a-061a59317753'} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:01.077727 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] The token cache is being invalidate because project 7170f10e7926408eba35e55738fc4a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80605) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 21 04:38:01.078337 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:01.078803 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG keystone.notifications [None req-b2f9a195-e8c3-4e7f-ae2a-061a59317753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80605) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 21 04:38:01.080475 dv-cinder-822822-6-smb devstack@keystone.service[80605]: [pid: 80605|app: 0|req: 1486/2933] 10.222.0.48 () {58 vars in 1232 bytes} [Thu Jul 21 04:38:00 2022] DELETE /identity/v3/projects/7170f10e7926408eba35e55738fc4a4d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 21 04:38:10.746604 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=12,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:38:11.074827 dv-cinder-822822-6-smb devstack@keystone.service[80605]: DEBUG dbcounter [-] [80605] Writing DB stats keystone:SELECT=5,keystone:DELETE=1 {{(pid=80605) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 21 04:42:25.707284 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] Authenticating user token {{(pid=80606) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 21 04:42:25.708705 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:42:25.776251 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65337d-1889-4c79-965a-c3d1b95f09db admin admin] Validating token access rules against request {{(pid=80606) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 21 04:42:25.833994 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afcb76a-f321-4ce1-862c-ccbab5d118ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8572e4c550014fc4b1aea3ddf16f7d2f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d0157137c144c9c87c3a2d26a502701', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80606) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 21 04:42:25.834635 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcb76a-f321-4ce1-862c-ccbab5d118ec service placement] REQUEST_METHOD: `GET` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 21 04:42:25.834920 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcb76a-f321-4ce1-862c-ccbab5d118ec service placement] SCRIPT_NAME: `/identity` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 21 04:42:25.835236 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afcb76a-f321-4ce1-862c-ccbab5d118ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80606) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 21 04:42:25.837885 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.fernet_utils [None req-0afcb76a-f321-4ce1-862c-ccbab5d118ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80606) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 21 04:42:25.849517 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcb76a-f321-4ce1-862c-ccbab5d118ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 21 04:42:25.851130 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afcb76a-f321-4ce1-862c-ccbab5d118ec service placement] RBAC: Authorization granted {{(pid=80606) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 21 04:42:25.861556 dv-cinder-822822-6-smb devstack@keystone.service[80606]: [pid: 80606|app: 0|req: 1448/2934] 10.222.0.48 () {60 vars in 1365 bytes} [Thu Jul 21 04:42:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 21 04:42:35.857335 dv-cinder-822822-6-smb devstack@keystone.service[80606]: DEBUG dbcounter [-] [80606] Writing DB stats keystone:SELECT=58 {{(pid=80606) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}